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I. INTRODUCTION 


A. BACKGROUND 

Efficiency, effectiveness and productivity have become hot 
topics in recent years. The failure of the United States to 
maintain parity in these areas has been touted as one of the 
ZmOOt causes of its receding competitiveness and loss of 
prominence in the global market place. 

In 1986, President Reagan signed Executive Order No. 12552 
calling for an improvement in productivity of 20 percent in 
all government agency operations by 1992. While this may have 
been considered a great step forward by some, most government 
agencies viewed this call-to-arms as an order to cut their 
Costs. A focus on improvement in overall performance 
(productivity, efficiency, effectiveness, quality, innovation, 
budgetability, and quality of work life) might have been a 
more germane EOp1cC Eon the executive order. 
[Ref. 1: p. 10] 

Currently, the entire federal government is in the middle 
of a strong movement to cut the budget deficit. The two areas 
of focus for deficit cutting measures are increased taxation 
and reduced spending, with the Department of Defense absorbing 


the largest budget reductions. Those reductions are placing 


tremendous pressure on the services in their efforts to 
maintain their warfighting capability. 

With the shrinking Navy budget, including Operations and 
Maintenance, Navy (O&M,N) funds, fleet commanders are being 
pressed into coping with expanding operational commitments on 
a diminishing operational budget. The LAMPS MK III?t 
Souimatyad. 7, which employs the SH-60B Seahawk helicopter, is no 
exception. Their resources are being stretched to the limit 
while they are expected to support an ever expanding list of 
operational requirements. The primary mission of a LAMPS MK 
III squadron is to deploy combat ready detachments and 
aircrews. The very nature of the detachment oriented LAMPS 
mission requires commanding officers to apportion resources 
within A constantly changing, priority Sstrveriumae: 

The LAMPS community consists of two fleet replacement 
squadrons, HSL-40 and -41, and eleven operational Squadrons, 
HSL-42 through -49, -51 and -37. The current Block I upgrade 
and required depot level maintenance are two of the major 
constraints that are facing the community by effecting the 
number of available aircraft. The Block II upgrade for the 
SH-60B helicopter is scheduled to enter service near the end 
of the decade. In addition, the surface platforms that employ 


and support SH-60B helicopters are increasing. Each East 


1 LAMPS stands for Light Airborne Multi-Purpose System. MK 
III refers to the third generation helicopter with the LAMPS 
designation. 


Coast squadron is now supporting eleven surface combatants 
instead of ten. 

The mission of a LAMPS MK III squadron is multifaceted, 
with primary emphasis on supporting deployable detachments at 
sea. This mission can be best accomplished by providing: 
high quality maintenance for the aircraft; maintenance 
technicians with sufficient training and skill development to 
perform the required tasks once deployed; quality training and 
skill development to aircrews; and ensuring that the existing 
squadron support structure can properly support the sea-going 
detachments. 

A secondary facet of the mission is to provide shore-based 
aircrew and maintenance technicians with ample training and 
skill development opportunities. Two major factors affecting 
squadron performance are the quarterly allocation of flight 
hours and the mission capability of the squadron’s aircraft. 

Increased operational commitments, while maintenance man- 
hours available remain relatively constant, puts into question 
the adequacy of the current LAMPS MK III maintenance 
measurement system to cope with current maintenance demands. 
To ensure squadrons meet operational requirements and remain 
within assigned fiscal constraints, the current manner in 
which the LAMPS MK III community measures maintenance 


performance should be studied. 


B. OBJECTIVES 
The objectives of this thesis are to: 
O Assess and evaluate the current levels of maintenance 
efficiency, effectiveness, and productivity within LAMPS 


MK III squadrons. 


O Identify areas where improvement opportunities exist in 
the maintenance performance measurement system. 


O Develop a non-financial performance measurement system 
that will measure the efficiency, effectiveness, and 
productivity of squadron maintenance efforts. 

C. RESEARCH QUESTIONS 
1. Primary research question: 

O Is the existing maintenance measurement system the most 
effective for coping with the current environment facing 
the LAMPS MK III community? If not, where are there 
opportunities for improvement? 

2. Secondary research question: 

O What are the current measures for monitoring the 
effectiveness, efficiency, and capability of the 
Maintenance process employed by the LAMPS MK III 
community? Do these measures reflect the quality and 
effectiveness of the maintenance performed? Are 
alternatives available? 

D. SCOPE, LIMITATIONS AND ASSUMPTIONS 
1. Scope 
The scope of this thesis will be limited to examining 
the current maintenance activities of a sample of LAMPS MK III 
squadrons. The primary emphasis will be on evaluating non- 


financial measures of performance of the maintenance 


department and assessing the overall efficiency and 


effectiveness of the department in achieving the objectives of 


the command. The specific areas of investigation will be: 


O The existing organizational level maintenance system. 
O The existing measurements of maintenance performance. 


O The practicality of these measurements. 


For the performance measures, only data and reports 
that currently exist in the Naval Aviation Maintenance Data 
System will be employed. The intention is to provide squadron 
maintenance officers with a performance measure using data 
available on reports that are already received by each command 
and not recommend any new reporting reguirements. 

2. Limitations/Assumptions 

The data used in this thesis was gathered from the 
Naval Aviation Maintenance Support Office (NAMSO) and Naval 
Aviation Logistics Data Analysis (NALDA) databases. This 
Material originates from the Visual Information Display 
System/Maintenance Action Forms (VIDS/MAFs)* used by each of 
the squadron maintenance activities. It is assumed that all 
of the data is accurate and that any biases are uniformly 


distributed throughout the population. 


“The Visual Information Display System/Maintenance Action Form 
is a multipurpose document used in the Maintenance Data Reporting 
System and the Visual Information Display System. OPNAVINST 
me oO.2E, NAMP, Vol. II, p. C-36. 


Aviation Fleet Maintenance (AFM) funds will be the 
primary source of financial data. Because the budgeting and 
obligation of Aviation Depot Level Repairables (AVDLRs) 
funding is beyond the control of the squadron, this data will 
Wee BA. Seanarea in determining the cost of maintenance. 
Flight hour funding will also not be considered because it has 
little direct effect on the cost of maintenance. However, 
aircraft flight hours flown will be considered, because of 
their effect on the availability of the aircralit ion 
maintenance, and the fact that flight hours are considered a 


Maintenance driver. 


E. DATA SOURCES 
1. Naval Aviation Maintenance Support Office (NAMSO) 
Database 
.NAMSO is the primary data collection facility for all 
aviation maintenance information. NAMSO also produces and 
distributes all of the monthly Maintenance Data Reports 
(MDRs) . In addition, the NAMSO database provides this 
information in response to specific queries centered area 
individual data fields contained in the MDRs. 
2. Naval Aviation Logistics Data Analysis (NALDA) 
Database 
The NALDA database is 
...an automated data base and information retrieval system 


for aviation logistics management and technical decision 
support. Analysis capability iS provided through 


interactive query and batch processing from remote 
terminals. AS a state-of-the-art management information 
system, NALDA assists users in making improved decisions 
affecting fleet aircraft readiness. Users can define, 
identify, and isolate logistics problem areas from a 
centralized data bank of integrated aviation logistics 
mibormation. [Ref. 2: p. C-24] 
NALDA provides information similar to that contained in the 
MDRs in response to specific queries. 
3. Aviation Fleet Maintenance (AFM) Funds 
AFM data was obtained from each of the fund 
administering activities (FAA) that support the CONUS LAMPS MK 
ITI squadrons. The FAA that supports the East Coast squadrons 
is Naval Station Mayport, Florida. West Coast squadron 
Support is provided by Naval Air Station North fIsland, 
California. 
4. Squadron 3-M Maintenance Summaries 
Squadron 3-M Maintenance summaries are locally 
produced documents that highlight specific areas of interest 
to the squadron maintenance officer. The squadron’s data 
analyst produces this report from information presented in the 
Maintenance Data Reports and the Subsystem Capability Impact 
Reports delivered to the squadron. 
5. . Interviews 
Seven squadron Maintenance Officers and both wing 
Maintenance Officers were interviewed. The objective of the 


interview was to determine an operator’s definition of 


readiness, explore implicit and explicit performance 


assessment criteria, assess the current fleet awareness of 
performance improvement elements (effectiveness, efficiency, 
productivity, quality, budgetability, innovation and Giuaiiae, 
of work life), and determine the significance of AFM funds on 
the maintenance officer’s decision making process. ial 
addition, both the East and West Coast Wing Maintenance 
Officers were interviewed. These interviews attempted to 
determine the perspective of the reporting senior of the 


squadron concerning the areas of interest. 


F. THESIS ORGANIZATION 


1. Chapter I: Introduction 
The environment facing the LAMPS MK III community will 
be discussed. In addition, the objectives, primary and 
secondary research questions, scope, limitations, and 
assumptions will be delineated. 
2. Chapter II: Background 
A brief overview of the Naval Aviation Maintenance 
Program, the maintenance organizational structure, and the 
duties of the maintenance officer will be discussed. 
3. Chapter III: Defining Performance Measurement 
The various factors affecting performance (productivity, 
effectiveness, efficiency, quality, innovation, budgetability, 
and quality of work life) will be defined and discussed. In 
addition, a synopsis of the performance measure model will be 
included. The various types of maintenance funds will be 
described. 
4. Chapter IV: Research Methodology and Alternative 
Performance Measures 
In this chapter, the sources of the data used to analyze 
this study will the discussed. The associated limitations 
involving the data selection and techniques of analysis will 
be analyzed. In addition, various performance measures 
addressing aviation maintenance will be described. The 
chapter will conclude with a delineation of the performance 
measures to be analyzed in Chapter V. 
5. Chapter V: Data Presentation 
The alternative performance measures discussed in 
Chapter IV will be analyzed and graphed. The significant 
Statistical observations will be highlighted. 


6. Chapter VI: Discussion of the MCP/PMT and Objectives 


Matrix 
The steps for developing and using the MCP/PMT and 
Objectives Matrix will be delineated. Performance measures 
that fit the performance improvement elements will be fitted 
to the MCP/PMT and Objectives Matrix. The resulting 
performance scores derived from the model will be graphically 
displayed. 


7. Chapter VII: Summary, Conclusions and Recommendations 
The highlights of the thesis will be included, as well 
as conclusions reached from the analytical research conducted. 
Specific recommendations addressing performance measurement 
within the context of the LAMPS MK III maintenance system will 
be presented in this chapter. In addition, related topics for 
further research will be presented. 
8. Appendix A: The Duties of the Maintenance Officer 
Delineates the specific duties of a squadron maintenance 
officer as per OPNAVINST 4790.2E, the Naval Aviation 
Maintenance Program. 
9. Appendix B: The Authorized Uses of Aviation Fleet 
Maintenance Funds. 
The specific types of purchases for which Aviation Fleet 
Maintenance funds can be used as per the NAMP. 
10. Appendix C: The Results of the Statistical Analysis. 
The results of the statistical analysis on each of the 
performance measures are summarized. The analysis includes 
the Analysis of Variance (ANOVA) test, small-sample hypothesis 
test for two population means, and large-sample hypothesis 
test for two populations. 
11. Appendix D: Activity Breakout Graphs 
The graphical representations of the frequency 
distributions concerning the specific activity groupings will 
be presented. 


II. BACKGROUND 


A. AVIATION MAINTENANCE PRINCIPLES 

A critical success factor of every naval aviation unit is 
its maintenance effort. A well managed maintenance activity 
optimizes equipment availability and minimizes downtime at a 
reasonable cost. A poorly organized or functioning 
maintenance department will misuse limited resources and over- 
utilize operational assets in achieving command objectives. 
If the maintenance activity of a command is not functioning 
properly, the unit will experience difficulties in functioning 
at its full operational potential. 

Readiness is defined as "the ability of forces, units, 
weapons systems, or equipment to deliver the outputs for which 
they were assigned." [REE 3? fe. pee ol In aviation 
maintenance terms, readiness implies that an aircraft is able 
to fly safely and all systems needed to complete the assigned 
mission are operating. Achieving and maintaining readiness is 
the single most important function of an aviation maintenance 
department. However, measuring readiness iS much more 
difficult than defining readiness. 

Two definitions of readiness emerged from the interviews 
of the squadron maintenance officers. The first definition 


described readiness in terms of the aircraft’s material 


me) 


Gendition as reflected by the mission capability (MC), full 
mission capability (FMC), and partial mission capability (PMC) 
figures. The second definition addressed the fundamental 
aspect of every aviation unit, having aircraft that are 
flyable and safe, and capable of meeting all assigned tasking. 
Other items discussed concerned parts availability and 
properly trained personnel. It is evident that the 
maintenance officers have developed definitions of readiness 


that provide a framework for achieving the squadron’s mission. 


B. NAVAL AVIATION MAINTENANCE PROGRAM (NAMP) 

OPNAV Instruction 4790.2E, the Naval Aviation Maintenance 
peoaran (NAMP), is the foundation on which all aircraft 
maintenance is based. The NAMP delineates the duties and 
responsibilities of all participants in the maintenance effort 
and provides detailed instructions for the documentation of 
maintenance actions. In addition, it stipulates specific 
reporting responsibilities and provides a basis for organizing 
the maintenance department in an aviation Squadron. 

1. Objective 

The objective of the NAMP is "to achieve and 
continually improve aviation material readiness and safety 
Standards established by the Chief of Naval Operations (CNO), 
with optimum use of manpower, material, and funds." 
Ref. 4: p. 2-1] These standards include the repair 


of aeronautical equipment at a level that ensures the optimum 
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use of available resources, the protection of weapon systems 
through an active corrosion control effort, the active Useaae 
the Planned Maintenance Program, and the collection and use of 
data to improve the performance of the maintenance personnel 
and the material condition of the equipment. [Ref. 4: p. 2-1] 
2. Performance Improvement Goals 

The NAMP has listed several broad performance 
improvement goals in an effort to continuously improve the 
maintenance practiced by the fleet aviation units and meet the 


Stated objectives. These goals are: 


O Increased readiness 

O Improved quality 

O Improved deployability 
O Improved sustainability 
O Reduced costs 


O Enhanced preparedness for mobilization, deployability, 
and contingency operations 


O Enhanced supply availability 


O Improved morale and retention [Ref. 4: p. 2-1] 


3. Performance Elements 
The NAMP notes seven performance elements that are to 
be the focus of the performance improvement effort. These 
seven performance elements are Productivity, Effectiveness, 
Efficiency, Quality, Innovation, Quality of Work Life, and 


Budgetability. These performance elements are the foundation 


eZ, 


of the NAMP’s performance improvement effort. Each element 
focuses on a part of the maintenance process. The NAMP 
charges all maintenance personnel to actively pursue any 
opportunity to achieve gains in any of these areas. Further 
discussion of the performance improvement elements will be 


conducted in Chapter III. 


C. LEVELS OF MAINTENANCE 

Aviation maintenance within the Department of the Navy is 
broken into three distinct strata. The delineation is based 
on the type of maintenance conducted and the level of 
assembly, subassembly, or component that can be repaired by 
the activity. 

1. Depot-Level Maintenance 


Maintenance (that is) performed at naval aviation 
industrial establishments to ensure continued flying 
integrity of airframes and flight systems during 
subsequent operational service periods. D-level 
maintenance is performed on material requiring major 
overhaul Or webu de Laane, Or parts, assemblies, 
subassemblies, and end items. It includes manufacturing 
parts, making modifications, testing, inspecting, 
sampling, and reclamation. D-level maintenance supports 
lower levels of maintenance by providing engineering 
assistance and performing maintenance that is beyond the 
capability of the lower level activities. [Ref. 4: p. 3-2] 


2. Intermediate-Level Maintenance 


I-level maintenance is the responsibility of, and 
performed by, designated maintenance activities in support 
of using organizations. The I-level maintenance mission 
1s to enhance and sustain the combat readiness and mission 
capability of supported activities by providing quality 
and timely material support at the nearest location with 
the lowest practical resource expenditure. [Ref. 4: p. 3- 
1] 
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3. Organizational-Level Maintenance 
O-level Maintenance is normally performed by an operating 
unit on a day-to-day basis in support of its own 
operations. The O-level maintenance mission is to 
maintain assigned aircraft and aeronautical equipment in 
a full mission capable status while continually improving 
the local maintenance process. [Ref. 4: p. 3-1] 

O-level maintenance is the primary area of focus of 
this thesis. In support of this objective, the data will 
relate to the maintenance efforts of the aircraft squadron. 
In addition, the squadron maintenance officer will be 
considered the primary individual in establishing the 


objectives, plans, and priorities of the maintenance 


department. 


D. UPKEEP MAINTENANCE 

There are two fundamental types of maintenance performed 
within the naval aviation maintenance system: rework and 
upkeep. The maintenance department of an aviation squadron is 
restricted to upkeep maintenance. Upkeep maintenance is 
further differentiated by being either scheduled or 
unscheduled. 

1. Scheduled Maintenance 

Scheduled maintenance is described as the "periodic 

prescribed inspection/servicing of equipment, done on a 
calendar, mileage, or hours of operation basis." [Ref. 2: p. 


C-30] Because this type of work is conducted on a periodic 
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basis, scheduled maintenance is a fairly predictable factor in 
the planning process. 

In the LAMPS MK III community, there are two primary 
categories of scheduled maintenance conducted by the O-level 
maintenance activity: phase and calendar inspections. Both 
of these inspections are designed to preserve the material 
condition of the aircraft and inspect certain items for wear. 

Phase inspections are conducted on a 150 flight hour 
interval. Phases are major repair actions that take two to 
four days to complete. Calendar inspections occur at a fixed 
time interval. Currently, there are 7, 14, 28, 56, 112, and 
224-day.inspections conducted on the SH-60B helicopter. The 
time periods for these inspections run concurrently. When the 
aircraft is deployed, the time period for these inspections is 
halved, with the exception of the 7-day inspection. 

Scheduled maintenance consists of two distinct phases. 
The first is the "look phase." In this phase, all the 
requirements for the completion of the inspection are 


performed, and any discrepancies or maintenance problems are 


documented. The second phase is the "fix phase" where the 
discrepancies discovered during the "look phase" are 
eernrected. 


2. Unscheduled Maintenance 
Unscheduled maintenance is defined as "maintenance, 


other than the fix phase of scheduled maintenance, occurring 
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during the interval between scheduled downtime maintenance 
periods." (Ret 23 3p. Ve-26) In essence, unscheduled 
maintenance is the repair work required because of 
malfunctioning equipment. The inherent unpredictability of 
unscheduled maintenance often shapes the apportionment of the 
squadron’s resources (man-hours and parts) to remedy the 


problem in a timely manner. 


E. ORGANIZATIONAL MAINTENANCE ACTIVITY 

The organizational level (O-level) maintenance activity is 
the lowest level in the maintenance hierarchy. It is at this 
level that the primary thrust of this thesis is aimed. The 
maintenance performed is usually at the aircraft subsystem 
level. Rarely do O-level technicians diagnose and repair the 
internal components of the equipment; instead, the component 
1s removed and replaced. 

1. Objectives 


The objectives of all O-level maintenance activities 


O Improved performance and training of personnel 
O Improved aircraft, equipment, and system readiness 


O Improved maintenance integrity and effectiveness for all 
material 


O Improved safety 
O Improved usage of manpower and material 


O Improved planning and scheduling of maintenance 


ic 


© Improved management and evaluation of work performance 
Se improved quality o£ the end product 
O Improved attainment and retention of combat readiness 


O Improved continuity when aircraft or personnel are 
transferred between commands. ([Ref. 4: p. 2-1] 
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Quality Assurance/Analysis Maint./Material Control Officer | Maint. Administration 





[ Maint. Control | | Material Control 
Aircraft Division | Avionics/Armament Division | Line Division 
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Airframes Branch Electrical/instrument Troubleshooters Branch 
Branch 


Aviation Life Suppprt Reconnaissance/Photo Support Equipment 
Systems Branch Branch Branch 


Inspecton Branch Armament Branch 





Figure 1 Typical Navy O-Level Maintenance Department 
Seganization 


2. Aviation Squadron Maintenance Organization 
The NAMP, Volume II, provides the basic structure for 


the maintenance department organization for an aviation 


Squadron (see Figure 1). The duties and responsibilities of 
the maintenance officer, subordinated line and staff 
positions, and various support activities are stated. This 


10; 


Standard organization is designed to provide a conduit for 
effective management. [Ref. 2: p. 3-1] 

The maintenance department is headed by the 
maintenance officer who has overall responsibility for the 
functioning of the department. The department consists of 
three functional areas: Quality Assurance/Analysis (QA/A) ; 
Maintenance Administration; and Maintenance/Material Control 
(M/MC). Maintenance Administration provides administrative 
support j@.e26 the maintenance department. Quality 
Assurance/Analysis provides essential post-maintenance flight 
safety inspections and data analysis. 

Moentenaneey/MaAceniem Control is responsible for the 
Aircraft, Avionics/Armament, and Line divisions. These 
divisions contain the functional branches that incorporate the 
Maintenance personnel required to repair the aircraft. 

The vast majority of aviation squadrons that utilize 
this organizational structure are either units that deploy as 
a command or shore-based training squadrons. Since the 
deployable squadrons relocate to the ship as a whole, their 
Organizational integrity remains intact. This allows for 
Significant continuity among the maintenance department’s 
activities, programs and objectives. 

3. Maintenance Officer 
The squadron maintenance officer heads the maintenance 


department and is responsible to the commanding officer for 


1s. 


the contribution of the department in achieving the squadron’s 
mission and goals. In light of this, the maintenance officer 
pilots the formulation of the objectives, plans, and goals of 
the department. The maintenance officer is the final 
evaluator and implementor of all new procedures and processes 
within the maintenance department. The maintenance officer’s 
performance evaluation is directly tied to the performance of 
the maintenance department; therefore, he is the primary 
Stakeholder in any performance improvement initiative 
undertaken. 

The responsibilities of the squadron maintenance 
Serrcer are listed in Appendix A; however, they can be summed 


fico the following four broad objectives: 


O Obtain optimum utilization of assigned personnel. 
O Obtain optimum utilization of assigned facilities. 
O Obtain optimum material Support. 
O Ensure proper maintenance procedures are conducted in 
accordance with applicable Ps eruceLloens . 
(Ret. 5; p. 30] 
These broad objectives help focus the performance 
improvement efforts of the maintenance department. 
4. The LAMPS MK III Squadron 
A typical LAMPS MK III squadron maintenance 
Peeartment’s goals and objectives are similar to any other O- 


level aviation maintenance activity. Because the operational 
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LAMPS squadron deploys under a detachment organization, vice 
the entire command, there are fundamental differences in the 
organizational structure. 

The two Fleet Replacement Squadrons, HSL-40 and HSL- 
41, do not utilize any detachments. This is due to the fact 
that they are training squadrons and do not deploy. 

a. The Detachment 

Detachments are small, semi-autonomous 
organizational units. Within the maintenance department, they 
are the sub-unit that actually performs the maintenance. 
Figure 2 depicts the typical squadron organization following 
the detachment concept. Because detachments deploy, all of 
the essential functions for stand-alone operations are 
included. In a sense, detachments are micro-maintenance 
departments. 

Each detachment is staffed by technicians from the 
four primary specialties required to perform work on the 
aircraft. The specialties are aviation machinists mate (AD), 
aviation electrician (AE), aviation electronics technician 
(AT), and aviation structural mechanic (AM). A one-aircraft 
detachment will usually be staffed with two personnel from 
each discipline. A two-aircraft detachment will be augmented 
with either an extra AD or AE. 

The detachment maintenance team is supervised by a 


chief petty officer (det CPO) who is responsible for the daily 
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Detachment Three __Work Center 310 Detachment Seven 


Detachment Four Detachment Eight 





Figure 2 Typical O-Level Detachment Concept Organizational 
Semel ure 


Maintenance effort of the detachment. The detachment 
maintenance officer (det MO) has overall responsibility of the 
detachment’s maintenance activity. When the detachment is 
attached to its parent Squadron, the det MO is responsible to 
the squadron maintenance officer for the performance of the 
detachment. When the detachment is deployed, the det MO falls 
under the control of the detachment officer-in-charge (det 
Ore). 

While the detachments are ashore, they are 
responsible to Maintenance Control, and the maintenance 


control officer, for the performance of their assigned work. 


Zi 


Twice daily, at the beginning of each shift, Maintenance 
Control establishes the priorities for each of the detachments 
and their respective aircraft. While the detachment is 
deployed, the det MO exercises the maintenance control 
Ud Gitean@ rae 

All of the Atlantic Fleet LAMPS MK III maintenance 
departments are organized under the autonomous maintenance 
unit, or detachment, concept. Aircraft and personnel are 
assigned to these detachments on a continuous basis. Each of 
the detachments of the Atlantic Fleet LAMPS MK III squadrons 
are assigned to a specific ship in the Atlantic Fleet ona 
semi-permanent basis. 

All of the squadrons surveyed from the Pacific 
Fleet are organized under the more traditional maintenance 
Organizational structure. West Coast squadrons form 
detachments approximately six months prior to the deployment. 
Detachments are formed for specific deployments and ships. 
Once the commitment is completed, the detachment may be 
employed to meet any other commitment with any other ship that 
may arise. Once all of the detachment’s commitments have been 
met, the detachment is dissolved and the personnel are re- 
absorbed into the squadron’s maintenance shops. In the 
Pacific Fleet, ships are not permanently assigned to squadrons 
and detachments as they are in the Atlantic Fleet. 
Ship/detachment assignments only last for the duration of the 


work-up/deployment/post-deployment cycle. 


22 


b. Support Functions 

In a LAMPS MK III squadron maintenance department, 
the support functions of Quality Assurance/Analysis (QA/A), 
Maintenance Administration, and Material Control are handled 
in the same fashion that they are addressed in any other 
maintenance activity. QA/A provides the basic quality control 
and standardization for all maintenance practices performed 
within the squadron. Maintenance Administration Supports the 
squadron and detachments by processing shed routine 
administrative matters. Material Control provides the 
detachments and work-centers within the squadron with supply 
services. One notable exception is that quality assurance 
functions are assigned to the detachment technicians for their 
deployed periods. When the detachment returns to the parent 
squadron, the detachment’s quality assurance requirements are 


filled by the squadron’s QA/A department. 


F. AVIATION MAINTENANCE DATA COLLECTION AND REPORTING 
1. Naval Aviation Maintenance Office (NAMO) 

The Naval Aviation Maintenance Office (NAMO), located 
at NAS Patuxent River, Maryland, is a support facility for all 
naval aviation maintenance activities. Its primary mission is 
"Co coordinate aviation fleet maintenance support to ensure 
optimum aviation maintenance performance and fleet readiness 
and to provide technical support in aviation life cycle 


logistics and maintenance planning."[Ref. 6: p. 1] 
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One of the primary functions of NAMO is to provide 
productivity improvement support.[Ref. 6: p. 2] An activity 
within NAMO that assists in this endeavor is the Naval 
Aviation Logistics Data Analysis (NALDA) database. The NALDA 
database provides reports based on specific inquiries by 
designated users. 

2. Naval Aviation Maintenance Support Office (NAMSO) 

The Naval Aviation Maintenance Support Office (NAMSO) 
is under the command of the Naval Sea Logistics Center in 
Mechanicsburg, Pennsylvania. It serves as the primary 
collection facility for all aviation maintenance data. NAMSO 
also generates the various reports used by the individual 
Maintenance activities for monitoring and self-reporting. 

3. Types of Aviation Maintenance Reports 
a. Maintenance Data Reports 

These reports are printed monthly and are available 
for use by each maintenance activity. The information used to 
produce these reports is generated by each maintenance 
activity on VIDS/MAFs. One of the primary uses of the reports 
is to provide the basic data for the squadron 3-M maintenance 
summaries. In addition, these reports provide the foundation 
for any performance improvement effort. The most relevant 
reports to the squadron maintenance officer are included in 


Figure 3. 
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' Monthly Lists all maintenance actions in work center (WC) 


f Production Report sequence including technical directive (TD) 

} (MDR-2) compliance, and data entered in the (H-2Z) 
Failed/Required Material block of the VIDS/MAF. [Ref . 
| eee Pp. 3-13] 

r 


Technical This report gives a detailed list, by organization, of 
Directive TD compliance during the reporting period. [{Ref. 7: p. 
Compliance Report 3-16) 

(MDR-4-1) 


Maintenance | This report consolidates all maintenance actions by 
mee on by BU/SERNO sequence, including SE, TD compliance, and 
Bureau/Serial component repair at the IMA. This report is designed 
Number Report to provide a history of maintenance actions by 


(MDR-5) BU/SERNO and is intended for O- and I-level managers, 
analysts and MOs.[Ref. 7: p. 3-20) 


Component This report provides a spread of AT (action taken) 

Repair/Beyond codes for maintenance actions taken by the I-level and 

Capability of provides the MO and the maintenance/material control 

Maintenance | officer with an overview of the entire production 

Report (MDR-7) effort of the activity by work center and WUC within a 
type of equipment. [Ref. 7: p. 3-23) 





Failed . This report is prepared from data submitted on 
Parts/Parts VIDS/MAFs with TRCODE 12 or 32 and a MAL code (not 
Required Report 000) entered in the (H-Z) Failed/Required Material 
(MDR- 8) block. This report is intended for the MO, material 
control officer, and work center supervisors. [Ref. 7: 
p..3526) 
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Repair Cycle Data This monthly report is a detailed list, by 

Report (MDR-9) | organization, showing the number of days of turnaround 
time (TAT) and the elements that compose the TAT for 
each repairable component processed through the I- | 
level as documented on the VIDS/MAF, or Metrology 
Equipment Recall (METER) card TRCODE 31 or 32.[Ref. 7: 
p. 3-28] 


Corrosion This report is designed for monitoring the Corrosion 

Control/Treatment Prevention and Control Program or for investigating 

Report (MDR-11) the amount of corrective corrosion treatment 
necessary. [Ref. 7: p. 3-32] 


No Defect Report This report shows the amount of time and effort 
(MDR-12) expended on maintenance for which there is no 
malfunction or alleged malfunction. [Ref. 7: p. 3-34] 





Figure 3 Maintenance Data Reports 
b. Subsystem Capability and Impact Reporting (SCIR) 


SCIR reports show an equipment’s mission capability. 
These reports are prepared from VIDS/MAF documents which 
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have a valid equipment operational capability (EOC)? code 
in the Repair Cycle or Maintenance/Supply Record section. [Ref. 7: p. 
3-38] 


See Figure 4 for a summary of the SCIR reports that are used 
by the O-level maintenance officer. 

c. Squadron Monthly Maintenance Summaries 
the 3-M Maintenance 


As mentioned in Chapter I, 


Summary is a report that is generated by the squadron’s data 
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This report is designed to show, by BU/SERNO, the 
total number of discrepancy hours limiting the 
equipment from performing its assigned mission or 
function during the reporting period. This report 
also denotes equipment utilization. [Ref. 7: p. 3-38] 


Monthly Equipment 
Discrepancy and 
Utilization Report 
(SCIR-3) 


Monthly Equipment 
Capability Report 
(SCIR-4) 


Monthly Equipment 


This report is designed to reflect equipment 
capability to perform its assigned mission/function 
during a reporting period. [Ref. 7: p. 3-40] 


This report is designed to display SCIR hours by 


Mission Capability 
Summary Report 
(SCIR-5-1) 


mission category and awaiting maintenance (AWM) hours 
by reason codes, summarized for a given EOC code and 

associated WUC during a reporting period. [Ref. 7: p. 

3-42] 





This report shows SCIR hours by mission category and 
AWM hours by reason codes, summarized by a given EOC 
code and associated WUC by BU/SERNO. [Ref. 7: p. 3-44] 


Monthly Equipment 
Mission Capability 
Bureau/Serial 
Summary:- Report 
(SCIR-5-2) 


Figure 4 Subsystem Capability Impact Reports 


analyst. It 1S a synopsis of those maintenance statistics 


that are considered important by the command. The data for 


the report is generated from the Maintenance Data Reports 


3 The Equipment Operational Code (EOC) is a three-character 
alphanumeric code that identifies the degree of degradation to 
mission capability and the system responsibility for the 
degradation. [Ref. 2: p. C-8] 
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(MDRs) and the Subsystem Capability Impact Reports (SCIRs) 
provided to the squadron on a monthly basis. 

The LAMPS MK III squadrons on the East Coast 
complete the 3-M summary according to direction promulgated by 
their reporting senior, HSLWLANT. A comparable requirement 
does not exist for the West Coast squadrons. This may be the 
result of not having a type-wing until recently. However, the 
maintenance summaries generated by the West Coast squadrons 
highlight items that the command structure, primarily the 
Squadron maintenance officer and material control officer, 


deem important. 


G. TYPES OF AVIATION FUNDING 
Currently there are three categories of aviation funding 
in use by the U.S. Navy in budgeting and accounting for 
aviation activities: Flight Operations funds; Aviation Fleet 
Maintenance funds; and Aviation Depot Level Repairables funds. 
1. Flight Operations Funds (OFC-01) (OPTAR) 

Flight Operations funds are used to primarily pay for 
the fuel used by the squadron in flying its assigned hours. 
There are various consumables, like office supplies and flight 
clothing that are included in this funding title, however the 
costs of these are minimal compared to the cost of the fuel. 
These costs are irrelevant in determining a budgetability 


measure for the squadron maintenance department. 
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2. Aviation Fleet Maintenance Funds (OFC-50) (OPTAR) 

Aviation Fleet Maintenance funds are the primary 
source of funds for the aviation squadron maintenance officer 
to purchase repairable parts and consumable items that pertain 
to the maintenance of the aircraft. In addition, several 
indirect categories are included in this fund pool. This is 
the pool of funds that the maintenance department has direct 
control over and reflects the day-to-day maintenance cost of 
the aircraft. AFM will be the source of data for all 
budgetability measures developed in this thesis. 

3. Aviation Depot-Level Repairables (AVDLRs) Funds 

Aviation Depot-Level Repairables (AVDLRs) funds are 
used to finance the depot-level repair or replacement of parts 
that are beyond the maintenance capability of the squadron or 
intermediate maintenance level. The IMA has primary control 
over whether an AVDLR charge is incurred and thus retains 
control over these funds. [Ref. 2: pp. 6-130,132] This 
eliminates this type of funding from the scope of this thesis. 

The squadron maintenance officer is concerned with 
those parts that fall within the auspices of this system, but 
has no control over how these funds are employed. As long as 
a carcass is turned in for a repairable part, the squadron is 
only charged a fraction of the total cost of the item. If the 
squadron fails to return the carcass of an AVDLR item, then 


the squadron is charged full price. In either case, the 
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source of the funds for these parts comes from the squadron's 
AFM account. Still, it is imperative that the squadron 
maintenance officer monitor any transaction involving AVDLR 
parts due to the possible negative effect an unreturned part 
could have on the AFM funds available. However, these funds 
provide little information in developing a budgetability 


measure for an aviation Squadron. 


H. AVIATION FUND BUDGETING 

The method employed in the budgeting process to estimate 
these funds varies depending upon the type of funds in 
question. Flight Operations funds are determined primarily on 
the cost of aviation fuel required to operate an aircraft for 
an hour. This hour of flight is an average hour, designed to 
reflect some ground time as well as flight time. The price of 
fuel is determined each year by the contract that is awarded. 

Aviation Fleet Maintenance (AFM) funds and Aviation Depot 
Level Repairables funds are estimated based on historical 
averages. The total costs incurred over a previous time 
period is divided by the total hours flown during the same 
period. [Ref. 8: p. 42] AFM and AVDLRs are 
essentially average costs. This average cost is. then 
augmented for an increase in prices and then multiplied by the 
estimated flight hours for the next period to determine the 


budget request for that period. 
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Aside from the major accounting differences between the 
Atlantic and Pacific LAMPS squadrons with regards to AFM, 
there existed a fundamental difference between these camps 
with regard to AFM usage. On the East Coast, an AFM budget is 
Submitted by each squadron to HSLWLANT. The wing in turn, 
submits the combined AFM budget to the FAA, NS Mayport. NS 
Mayport then includes the AFM request with the base budget and 
forwards that on to Commander, Naval Air Force Atlantic Fleet. 
When the grant is awarded, the process is reversed, with each 
squadron being accountable to the wing for their usage of the 
AFM funds. 

At NAS North Island, the LAMPS squadrons do not submit a 
budget to HSLWPAC for AFM funding. NAS North Island submits 
its AFM budget request for all of the aviation activities on 
the base. When the grant is made, it is given to the NAS 
North Island comptroller. There is no attempt to further 
apportion the money to the type wings or individual squadrons. 
Squadron maintenance officers are instructed to obligate funds 
and order parts until instructed by the comptroller to cease. 
This procedure is adequate provided one squadron or community 
doesn’t require an excessive amount of AFM funds to repair an 
emergent, high-priority problem. This procedure fosters an 
attitude of ambivalence toward AFM usage within the squadron 
maintenance department, which is in conflict with the 


responsibility of the maintenance officer to "employ sound 
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management practices in the handling of personnel, facilities, 


and material." [Ref. 4: p. 3-5] 


I. DEFICIENCIES IN BUDGETING FOR AFM 

There are several notable deficiencies associated with 
uSing an average cost approach for estimating AFM costs. The 
first 1s that an average is nothing more that a picture of the 
previous period. The use of an average cost figure assumes 
that all of the costs associated with maintaining an aircraft 
are directly variable based on flight hours. There is little 
predictive value in this point estimate. 

Secondly, the average cost fails to account for costs that 
are incurred regardless whether the aircraft flies. There are 
certain costs, for example tools, that occur on a basis other 
than flight hours. Tools are purchased using AFM and yet are 
included in the average cost of operating the aircraft. 

Third, by using an average cost, the budgeted AFM will 
only be accurate if the actual flight hours flown exactly 
Matches the budgeted hours. If the squadron’s flight hours 
exceed the hours used in the budget, the amount of AFM granted 
Mempbepair the aircraft will be insufficient to properly 
maintain the aircraft unless additional funds are made 


available. 
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J. SUMMARY 

In this chapter, the following topics were discussed: the 
principles of aviation maintenance; the Naval Aviation 
Maintenance Program (NAMP) and its objectives toward aviation 
maintenance; the levels of maintenance within the U.S. Navy; 
the various types of maintenance conducted; the types of O- 
level organizational structures; the duties of the squadron 
maintenance officer; and the various reporting systems and 
reports available to the maintenance officer. 

A discussion of the types of aviation funds closed out 
this chapter. In addition, the procedure by which the AFM 
budget was developed and the flow of requests and funds was 
highlighted. Finally, the peculiarities in the budgeting and 
accounting of AFM between the Atlantic and Pacific Fleets were 
discussed. 

This chapter provided a background of all of the factors 
affecting aviation maintenance in today’s environment. The 
next chapter will discuss the basic tenets of performance 
measurement and list the current measures used to gauge 


maintenance performance in a LAMPS MK III helicopter squadron. 
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Iil. DEFINING PERFORMANCE MEASUREMENT 


In any organization, performance must be measured. libs 
managers don’t measure, they will be unable to determine 
whether their unit is fulfilling organizational objectives. 
It is obvious that any time objectives are established, 
performance must be measured to determine if the objectives 
are achieved, and to what degree. Put simply, measuring 
performance is one of the cornerstones of management control. 

Within the context of aviation maintenance, performance is 
measured in avariety of manners. The metrics range from the 
ubiquitous Mission Capability and Full Mission Capability 
Rates to documentation and message error rates. In each case, 
the intent is to provide the manager with some level of 
feedback to evaluate and monitor the performance of the 


department. 


A. FACTORS IN DEVELOPING A PERFORMANCE MEASUREMENT 

Any measure of performance is more often than not a 
Surrogate measure. Because of the nature of the system or the 
limited resources available, the actual performance of a 
system or unit is rarely measured. Instead, surrogate measure 


are used to infer the performance of a system. Currently, the 
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measure of mission capability (MC/FMC/PMC/NMC) is a surrogate 
measure of aviation maintenance. 

Performance measures can be broken in to two categories: 
input and output. An input measure, iS a metric of the 
resources used by a system in the completion of its assigned 
activity. An example of an input measure is the amount of 
direct material used compared to the amount of direct 
Mabeniaks expected to be used: 

An output measure iS a measure of the results of the 
system. The output measure differs from the actual 
performance of the system in that the output measure examines 
only one or two factors of the system. The relation derived 
from anaes one or two factors is used to make an inference as 
to the performance of the entire system. An example of an 
output measure is the average number of maintenance man-hours 
per flight hour (MMH/FH). 

In the measurement of performance, several objectives must 
be considered. These objectives assist in developing a 
performance measure that is effective and valuable. A 
performance measure that doesn’t attempt to optimize these 
objectives will fail to be of any value to the manager. 
Figure 5 highlights some criteria that should be considered in 


evaluating performance measures. 
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Does the measure or set of measures in 
fact measure or specify that which it 
purports to do? 


Accuracy and Precision Does the measurement system accurately 
; and precisely measure the "true" 
statistic of a given phenomenon? 


Completeness In the case of a meaSurement system 
where we are interested in completely 
specifying the behavior of a 
phenomenon, the total set of measures 
| in the system should be collectively 
exhaustive or include all measurable 
variables. 


Uniqueness Specific measures should be unique and 
thus should not be redundant or overlap 
other measures. 


Reliability Measures should consistently provide 
valid results. 


Comprehensibility Measures used should be simple and 
understandable as possible and still 
convey the message and meaning 
intended. 


Quantifiability A measure should be quantifiable in 
order to better understand its meaning. 


Controllability Measures should reflect variables, 
factors, relationships or any 
phenomenon that the organization has 
control over. 


Cost Effectiveness | The measures should be cost 
effective. [Ref. 9: pp. 68-69] 





Figure 5 Criteria for Evaluating Performance Measures 


B. SEVEN ELEMENTS OF PERFORMANCE MEASUREMENT 

There are seven independent, though not mutually 
exclusive, elements for measuring performance. Every manager 
in an organization either monitors, evaluates, or controls at 
least one of these measures of organizational performance. 


These seven elements are: 
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O Effectiveness 

O Efficiency 

O Quality 

O Produecervaery 

O Quality of Work Life 

O Weudgetabittey  (Protsranmienry 

O Innovation (preductr and process) [ReE£. 9E pe 

248] 

These performance measurement elements are identical to the 
seven performance improvement elements delineated by the Naval 
Aviation Maintenance Program (NAMP). 

These seven elements are the fundamental factors of 
performance. Each performance improvement element describes 
a unique aspect of the performance of an organization or 
activity. Figure 6 graphically displays the location of each 
of the seven performance improvement elements in a typical 
system. As depicted, these seven elements are pervasive in 
the operation of the system and attempt to develop a "whole- 
system" view of the organization’s performance. These 
performance elements provide the framework for evaluating the 
performance of the LAMPS MK III squadron’s maintenance 
department and for establishing a performance measurement 
model . 

: Profitability is primarily a term employed in the private 
sector, budgetability is more appropriate for public sector 


activities and therefore more relevant to this study. In addition, 
the NAMP uses budgetability to describe this element. 
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Figure 6 Organizational System and the Operational Definitions 
of Seven Performance Criteria 


1. Effectiveness 

Effectiveness is defined as "the degree to which 
things are produced that are of correct quality (zero 
discrepant) and within the allowed process or flow 
times."{Ref. 10: joe 41] The Naval Aviation 
Maintenance Program defines effectiveness as a function of the 
outputs of a system and their relationship to the achievement 
of the unit’s goals. [Ref. 4: p. 2-1] 

In measuring effectiveness, a comparison is made 
between what was planned and what was accomplished. Figure 7 
provides an operational definition of effectiveness. Since, 
effectiveness metrics follow the transformation process and 
measure the results of the system, they are output measures. 


[Ref 9: p. 42] 
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Figure 7 Operational Definition of Effectiveness 


2. Efficiency 
Efficiency is defined as "the degree to which the 


system uses the right resources; e.g., no unplanned overtime, 
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Figure 8 Operational Definition of Efficiency 


additional personnel, or additional equipment." [Ref. 10: p. 


41] The NAMP describes efficiency as "the relationship 
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between actual and planned resources. It tells how well the 
resources were used, aS in manpower utilization." [Ref. 4: p. 
2-2] 

Efficiency is a comparison between the quantity of 
resources that were expected to be used and those actually 
used. Figure 8 depicts the position of efficiency measures 
within the system. These resources can be any input to the 
process, money, labor hours, etc. The planned usage is 
determined by employing standards, estimates or budgets. 
Therefore, efficiency measures inputs to a system. [Ref. 9: 


pp. 42-43] 
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Figure 9 Operational Definition of Quality 


3. Quality 
Quality is "the degree to which the system conforms to 
requirements, specifications, or expectations." [Ref. 9: p. 
43] The NAMP defines quality as "the degree of satisfaction 
in a product or service as determined by the customer." [Ref. 
4: p. 2-2) Figure 9 depicts the prevalence of quality on an 


organization. In this case, quality describes how well 
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something is done. In a TQL responsive organization, the 
Standards that determine quality are driven by the needs and 
requirements of the customer. 

4. Productivity 

Productivity is defined as: 

The relationship of the amount produced by a given 
system during a given period of time, and the quantity of 
resources consumed to create or produce those outputs over 
the same period of time. [Ref. 9: p. 3] 

Productivity is further defined in the NAMP as: 

The outputs created by the system to the inputs required 

to create those outputs, as well as the transformation 


process of inputs to outputs. {Ref. 4: p. 2-1) 


In essence, productivity refers to how many tasks are 
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Figure 10 Operational Definition of Productivity 


completed over a given time period. Figure 10 depicts 
productivity within the context of the organizational system. 
It is important to remember that completing the job correctly 


igs a primary factor of productivity. 
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5. Quality of Work Life 

Quality of work life is "the way participants ina 
system respond to sociotechnical aspects of that system." 
[Ref. 9: p. 44] Figure 11 locates quality of work life in the 
organizational system. Within the Naval Aviation Maintenance 
Program, quality of work life is defined as "a function of 
morale and other factors which affect personnel pride and 
moecivation." [Ref. 4: p. 2-2] 

In essence, quality of work life considers how the 
people within the system feel toward the system. in ene 
military, this factor is often called "morale." Quality of 
work life affects the transformation process in the system. 


If quality of work life is high, and the workers enjoy what 
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Figure 11. Operational Definition of Quality of Work Life 


they are doing, the performance of those workers in the 


transformation process is higher. Quality of work life 


41 


measures are entirely subjective and are usually evaluated 
through: questionnaires and surveys. 
6. Budgetability (Profitability) 

While profitability is defined as "the relationship 
between total revenues (or in some cases, budget) and total 
costs (or in some cases, actual expenses)." [Ref 9: p. 43] 
The concept of budgetability is more applicable to the 
Structured military accounting system. In the NAMP 
"budgetability is the ability to perform the assigned mission 
within allotted resources." [Ref. 4: p. 2-2] Figure 12 
depicts the relationship of budgetability (profitability) to 


the organizational system diagram. 
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Figure 12 Operational Definition of Budgetability/ 
Profitability 


All naval units are given budgets, either as Total 
Obligational Authority (TOA) or as Operating Targets (OPTARs). 
LAMPS MK III squadrons are considered "cost centers" and are 


given an OPTAR each quarter. This OPTAR is divided into 
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several categories PAcrRuGdiIng wellnding @ tom flight hours, 

reparable parts and flight clothing, and training and travel. 
7. Innovation 

Innovation is "applied creativity." It refers to the 

process of either improving the existing system or inventing 

new processes and products. [Ref. 9: p. 45] See Figure 13. 

Innovation within the NAMP is defined as "creativity applied 


to the transformation process." [Ref. 4: p. 2-2] 
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Figure 13 Operational Definition of Innovation 


Within the Total Quality Leadership framework, this is 
one of the most important factors and yet it is the hardest to 
actually measure. Innovation iS crucial because it is the 


source of improvements that are to be made to the system. 


C. CURRENT PERFORMANCE MEASUREMENT IN AVIATION MAINTENANCE 
Readiness is defined as "the ability of forces, units, 


weapons systems, or equipment to deliver the outputs for which 


43 


they were designed." [Ref. 3: p. 299} Readiness is a term 
common throughout the military describing a unit’s or 
equipment’s ability to perform in a combat situation. This is 
a somewhat arbitrary measure of performance because first, it 
is an estimate and second, when a combat situation arises, 
there are no guarantees that a piece of equipment will be used 
effectively. This 1S primarily due to the integral 
involvement of people in the system. 

As described previously in Chapter II, the squadron 
Maintenance Officers that were interviewed defined readiness 
as the ability to meet commitments and have flyable aircraft 
available. In this case, meeting a commitment by having an 
aircraft in the air or embarked on a ship when it deploys 
provides little assurance as the how effective that asset will 
be employed. The key factor is the personnel employing the 
aircraft. This points to a conclusion that any measure of 
readiness is nothing more than an arbitrary statistic. 

The primary indicator of readiness is the Material 
Condition Reporting status of the aircraft. These operational 
capability designations are a series of categories that 
describe an aircraft’s overall ability to perform some or all 
of the missions for which it is assigned. Figure 14 describes 
the various different designations within the Material 
Condition Reporting System. These measures are mutually 
exclusive and provide a snapshot of the performance capability 


of the aircraft at a particular point in time. The Material 
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Optimum Performance The maximum capability for successful completion 

Capability (OPC) of all assigned missions, through the 
availability of all equipments, within the 
mission capability of an aircraft[Ref. 7: p. C- 
Lae. 


| Mission Capable (MC) whe material@econdition ofan alrcraft “indicating 
it can perform at least one and potentially all 
| of its designated missions, categories A through 
L, as defined in the applicable Mission 
Essential Subsystem Matrix (MESM). MC is 
further defined as the sum of Full Mission 
Capable (FMC) and Partial Mission Capable 
(PMC) [Ref. 7: p. C-17]). 


Full Mission Capable The material condition of an aircraft or 

(FMC) training device, indicating that it can perform 
all of its missions as assigned in the 
applicable MESM[Ref. 2: p. C-22]. 


Partial Mission Capable The material condition of and aircraft or 

(PMC) — training device, indicating that it can perform 
at least one, but not all of its missions...as 
defined in the applicable MESM[Ref. 2: p. C-22]. 


Partially Mission The material condition of an aircraft or 

Capable-Supply (PMCS) training device, indicating that it can perform 
at least one, but not all of its missions 
because maintenance required to clear the 
discrepancy cannot continue due to a supply 
shortage [Ref. 2: p. C-22]). 


Partially Mission The material condition of an aircraft or 

Capable-Maintenance training device, indicating that it can perform 

(PMCM) at least one, but not all of its missions 
because of O- or I-level maintenance 
requirements existing on the inoperable 
subsystem(s) [Ref. 2: p. C-22]. 


Not Mission Capable Not Mission Capable refers to "the material 

(NMC) condition of an aircraft or training device, 
indicating that it is not capable of performing 
and of its missions[Ref. 2: p. C-22]. 


Not Mission Capable The material condition of an aircraft or 

Supply (NMCS) training device, indicating that it not capable 
of performing any of itsS missions because 
maintenance required to clear the discrepancy 
Cannot continue due to a supply shortage[Ref. 2: 
Demeeeol. 


Not Mission Capable- The material condition of an aircraft or 

Maintenance (NMCM) training device, indicating that it is not 
capable of performing any of its missions 
because of O- or I-level maintenance 
requirements [Ref. 2: p. C-22]. 





Figure 14. Summary of Material Condition Reporting Status 
Designations 
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Condition Reporting System encompasses the primary means 
currently utilized for measuring the "readiness" of an 


aircraft and thus the associated maintenance effort. 


D. THE MULTI-CRITERIA PERFORMANCE/PRODUCTIVITY MEASUREMENT 

TECHNIQUE (MCP/PMT) AND THE OBJECTIVES MATRIX 

The Multi-Criteria Performance/Productivity Measurement 
Technique (MCP/PMT) is an "innovative, widely applicable, and 
reaeenanne simple approach to measuring group 
performance."[Ref. 1: p. 214] The MCP/PMT, when used in 
conjunction with the Objectives Matrix, provides a system of 
measuring the performance of an organization in each of the 
seven performance elements: effectiveness, efficiency, 
quality, productivity, quality of work life, budgetability, 
and innovation. Within each performance element, the observed 
pévtormenee 1s normalized through the use of a common scale 
that ranks performance figures. These scores are then 
weighted by their relative importance to the organization and 
aggregated for a total performance score. The comparison of 
the individual performance element’s score and total 
performance score over time will assist the management of the 
Organization to observe the results of any efforts at 
performance improvement. [Ref. 1: p. 285] Figure 15 shows an 
example of the Objectives Matrix used in conjunction with the 


MCP/PMT model. 
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The basic goal of any performance measurement process is 
to "develop relationships between measures of output and 
measures of input that enable practitioners to make decisions 
and pyateteeus manage their systems."[Ref. 9: p. 28] In addition 
to meeting this goal, the MCP/PMT enables comparison of the 
performance element against a family of measures. The MCP/PMT 
can be employed to provide feedback to the units management. 
[Ref. 1: p. 276] Within the framework of avaatued 
maintenance, the performance measurement model (MCP/PMT) can 
be used to identify areas that require further attention by 
the maintenance department leadership. In addition, the 
MCP/PMT will provide the squadron maintenance officer a tool 
to measure the performance of the department in the areas of 
efficiency, effectiveness, PECGUG Binginen = quality, 
budgetability, quality of work life and innovation. The 
performance improvement model will help quantify the effects 
of any performance improvement initiatives undertaken by the 


maintenance department. 


E. MODEL SELECTION 

The MCP/PMT model and the Objective Matrix combination was 
chosen from a variety of performance improvement models 
researched for three reasons. First, the MCP/PMT model and 
Objectives Matrix are simple to use. The model divides the 
performance of a system into the seven performance elements 


and yields a single performance score. In addition, the model 
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closely resembles a variety of matrix-type measurement systems 
currently in use by the aviation community. 

The second reason for choosing the MCP/PMT-Objective 
Matrix team iS because it focuses on the seven performance 
improvement elements that are highlighted in the NAMP. This 
model fits easily into the structure of the existing 
regulations and assists the squadron in meeting the associated 
performance improvement requirements. 

Third, this model assists the user in evaluating the goals 
and objectives of the system being examined. This model helps 
by identifying the activities within a maintenance department 
that directly support each of the seven performance 


improvement elements. 


F. SUMMARY 

The seven elements of performance measurement were covered 
in this chapter. In addition, several considerations in 
measuring performance were outlined. The current performance 
measures existing in aviation maintenance were highlighted. 
And finally, fundamental concepts behind the Multi-Criteria 
Performance/Productivity Measurement Technique (MCP/PMT) and 
the dint eens nee Matrix were introduced. 

Chapter IV will provide a discussion of the research 
objectives of this thesis. The statistical techniques and 
tests that will be used in the analysis of this study will be 


explained. In addition, the chapter will include a variety of 
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possible performance measures within the context of five of 


the seven performance improvement elements. 
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IV. RESEARCH METHODOLOGY AND ALTERNATIVE PERFORMANCE 


MEASURES 


This chapter will begin with a description of the four 
sources for the data used in this’ study. The various 
statistical tests will be delineated, in conjunction with the 
threshold of statistical significance. This chapter will 
conclude with a description of several alternative measures of 
aviation maintenance performance within the guidelines of five 


of the seven performance improvement elements. 


A. DATA SOURCES 
As mentioned in Chapter I of this thesis, data was 
gathered from a variety of sources. 
i 3-M Aviation Individual History Summary 
The primary report used for the data analyzed in this 
Study was the 3-M Aviation Individual Aircraft History 
Summary, NAMSO 4790.A7166-01. This report provided a variety 
of maintenance statistics about each aircraft bureau/serial 
number active during the time period of January 1991 to 
December 1992, and broke the information into monthly periods. 
The 2 beni of interest are included in Figure 16. 
A problem arose with the information provided in this 


report; some of the data fields about particular aircraft were 


Del 


Organizational (ORG) Code 

Element In Service (EIS) Hours 

Total MC Percentage 

Total FMC Percentage 

Not Safely Flyable (NSF) Hours-Maintenance 
Not Safely Flyable (NSF) Hours-Supply 
NMC-Unscheduled Maintenance Hours 
NMC-Scheduled Maintenance Hours 
NMC-Supply Hours 

PMC -Maintenance Hours 

PMC-Supply Hours 

SCIR-Maintenance Hours 

SCIR-Supply Hours 

Total Flight Hours 

Total Flights 

Total Ship Flight Hours 

Total Ship Flights 

Scheduled Direct Maintenance Man-Hours 
Unscheduled Direct Maintenance Man-Hours 
Cannibalization Items 

Cannibalization Man-Hours 

Corrosion Man-Hours 

Number of Aborts 





Figure 16 3-M Aviation Individual Aircraft History Summary 
Data Fields 


incomplete. The report was received unscrubbed, meaning all 
the available information was displayed, regardless of whether 
all required data fields were complete. In the data fields 
for material condition status (FMC/PMC/NMC), Element In 
Service (EIS) time, flight hours, and flights’ flown, 
incomplete information was supplemented with data gathered 
from the Flight Activity and Inventory (0712) Report. 
According to personnel at NAMSO, approximately 82 perceltaes 
the NAMSO database is complete. The primary reason given by 
NAMSO for this condition is that the documentation completed 


by the individual squadrons is never received at their 
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facility. This lack of data forced the elimination of one 
squadron from analysis in this thesis. 
2. Flight Activity and Inventory (0712) Report 

The second source of information was the Flight 
Activity and Inventory Report (0712) produced from the Naval 
Aviation Logistics Data Analysis (NALDA) database. Tyas 
report provided the following data for the period June 1990 to 
May 1993: ai GeGatein reporting inventory, Elight hours, 
sorties, EIS hours, NMCM-Scheduled hours, NMCM-Unscheduled 
hours, NMCS hours, and PMCM hours. The information in this 
report also provided backup for the incomplete fields in the 
NAMSO 3-M Aviation Individual History Summary. 

3. Equipment Condition Analysis (0500) Report 

The third report used as a source of performance data 
was the Equipment Condition Analysis (0500) Report. This 
NALDA produced report was the source of the number of 
maintenance actions completed by organizational code (ORG)? 
Guring the months selected, June 1990 to May 1993. Thais 
information was matched to the aircraft by the reporting 
organizational code. 

Maintenance actions were often divided as aircraft 


Peme Eransterred between organizational codes within the same 


> An Organizational Code is a structured three character 
alphanumeric code that identifies activities within a major 
command. [Ref. 2: p. C-8] In the LAMPS MK III community, 
organizational codes are used to identify detachments and the 
shore-based work force within each squadron. 


oye) 


month. This posed little difficulty as long as aircraft were 
transferred to another detachment within the same squadron. 
However, when aircraft were transferred between squadrons, the 
maintenance actions were assigned to the organizational code 
under which the maintenance information from the 3-M Aviation 
Individual Aircraft History Summary was reported. 
4. Comptroller Reports 

There were two types of data used in the analysis of 
data for budgetability measures: flight hours flown and AFM 
data. The data concerning Aviation Fleet Maintenance funds 
was gathered from the comptroller of NAS North Island, 
California for all of the Pacific Fleet LAMPS units and NS 
Mayport, Florida for the Atlantic Fleet commands. These 
reports identified what amount of AFM was executed by month 
from January 1991 to December 1992. 

NAS North Island is the Fund Administering Activity 
(FAA) for all units stationed there. The comptroller 
department receives the total amount of AFM that is granted 
each year for all activities at the base. NAS North Island 
continues to monitor the execution of AFM transactions 
regardless which numbered fleet the activity is operating 
under. Every dollar of AFM that is executed by deployed LAMPS 
detachments is counted towards the parent Squadron’s total AFM 


expenditure for the year. 
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Due to the type of accounting system and AFM execution 
procedures in place, AFM expenditures for each operational 
squadron by month were unavailable. Instead, a monthly total 
mon all operational squadrons was generated. 

For the East Coast, Naval Station Mayport is the FAA 
for the Atlantic Fleet LAMPS squadrons. However, only AFM 
transactions that occur within the Atlantic and Second Fleets 
are tracked by this FAA. Any transactions that are executed 
by detachments supporting Sixth or Seventh Fleet operations 
are handled through NAS Sigonella’s comptroller department. 

“The flight hour data sources were previously mentioned 
in this chapter. However, there are some facts that affect 
the development of budgetability measures. First, the flight 
hours for the Atlantic Fleet (HSL-42, -44, -46, -48) 
squadrons, obtained from the 3-M Aviation Individual Aircraft 
History Summary (NAMSO 4790.A7166-01), were divided into total 
hours flown and total at-sea hours flown. There was no 
differentiation in the at-sea flight hours as to under which 
fleet (Second, Sixth or Seventh) they were flown. This hourly 
total subtracted from the total flight hours flown resulted in 
the number of hours flown in Support of Atlantic and Second 
Fleet operations. This gave a denominator that corresponded 
to the Atlantic Fleet AFM figures received from the NS Mayport 
comptroller. 

An attempt was made to determine the quantity of at- 


sea flight hours flown. HSLWLANT, the East Coast wing, 
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attempted to verify the deployment dates and locations for 
each squadron’s detachments for the period from January 1991 
GO) Decenbew igo Z, However, this proved to be impossible. 
This proved to be an insurmountable block in the development 


of budgetability measures. 


B. TECHNIQUES OF ANALYSIS 

In the analysis of the data, three statistical tests were 
employed, and the results of which are summarized in Appendix 
C. The ease test used was the Analysis of Variance (ANOVA) © 
test. All squadrons were analyzed together and an F-statistic 
was generated. With a probability level of five percent, an 
F-statistic greater than 1.88 suggests that at least two of 
the squadron means were significantly different than the rest. 
In the case of every measure analyzed, the observed F- 
Statistic was greater than the threshold level. This 
indicated that each of the squadron means observed could not 
be used to make inferences about the population. 

The second test performed was a small-sample hypothesis 
test for two population means. Each squadron, with 24 
observations, was compared to the entire group, with 231 
observations, in an attempt to determine if the squadron mean 


was Significantly different from the entire group mean. In 


6 An ANOVA is a test used to make inferences about the means 
of several populations. [Neil A. Weiss and Matthew J. Hassett, 
Introductory Statistics, Third Edition, Addison-Wesley Publishing 
Co. Reading, MA, 1991, p. 705] 
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Zonmcace, a C- scone was developed and a 5 percent probability 
level was used. The results are Summarized in Appendix Cc. If 
the t-score exceeded the score associated with the confidence 
level, then the squadron’s mean was different than the group’s 
mean. The magnitude of the t-score also inferred the 
magnitude of the difference. 

In an effort to determine if a significant difference 
existed between specific groups of activities, the third test 
conducted waS a large-sample hypothesis test for two 
population means. Three tests were performed: fleet 
replacement squadrons (FRS) vs. all deployable squadrons 
(Sea); all Atlantic Fleet squadrons (LANT) vs. all Pacific 
Fleet squadrons (PAC); and all Atlantic Fleet deployable 
Squadrons (LANT-Sea) vs. all Pacific Fleet deployable 
squadrons (PAC-Sea). In each test, a z-score was developed 
and compared to the z-score for a five percent probability 
level. If the observed z-score exceeded 1.645, the two 
populations were determined to be significantly different. 

The basic analysis techniques as discussed above were 
attempted for the budgetability measures. In addition, a 
linear regression technique was attempted on each different 
Geeivity im an effort to determine the extent to which AFM was 
dependent upon flight hours’ flown. The intent was to 
determine if there is some portion of the AFM expenditure that 
might be considered a fixed cost required by each squadron 


independent of flight hours. Provided that a strong linear 
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relationship existed, the regression line, and corresponding 
equation, would provide an AFM budget target for the squadron. 

In conducting this analysis, the actual AFM expenditures 
were regressed against flight hours flown to determine the 
strength of the relationship between these two figures and to 
determine a formula for the resulting regression aime 
However, the data received was significantly flawed and thus 


unsuitable for any budgetability measure analysis. 


C. INTERVIEWS WITH THE SQUADRON AND WING MAINTENANCE OFFICERS 

Seven: squadron and two wing Maintenance Officers were 
given structured interviews in conjunction with this thesis. 
The interviews attempted to determine the respondent’s 
definition of readiness, awareness of the seven performance 
improvement elements and definition for each, and the impact 
of AFM funding on their maintenance efforts. As part of the 
interview, each respondent was asked to rank and weigh each of 
the seven performance improvement elements. The results of 
these interviewS were analyzed and used to create the 


alternative measures of performance. 


D. MEASURES OF EFFECTIVENESS 

As defined previously, effectiveness is the degree to 
which the system produces the right things according to the 
correct specifications within the allotted time constraints. 


In terms of aviation maintenance, effectiveness implies that 
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all Bae ten scheduled was performed, the work was completed 
according to the applicable instructions, and the aircraft was 
available to fly. In essence, all of the material condition 
Statistics (FMC/PMC/NMC) are effectiveness measures. iG 
addition, flight hours flown can also be considered a measure 
of effectiveness. Actual flight hours is output and any 
measure of actual output provides some statistic about how 
effectively the system operates. 

However, these measures are not a measure of overall 
performance. This becomes evident when all of the different 
performance measures are viewed in relation to MC. The level 
of variance between the squadrons for each statistic is quite 
large. If these activities all have the same type aircraft, 
Similar work forces and similar organizational structures, the 
variances between the units should be relatively small. Based 
on the data gathered from the maintenance data reporting 
system, six alternative performance measures can help monitor 
and measure effectiveness in maintenance. 

1. Mission Capability (MC) Percentage 

Mission Capability (MC) is defined as the "material 
condition of an aircraft that can perform at least one and 
potentially all of its missions." (Ref. 11: Dy 2) 
Mission’ capability is calculated by subtracting NMC hours from 
Element in Service (EIS) hours and dividing the result by EIS 


hours. Mission Capability is a measure that is currently 
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employed to measure overall performance of the maintenance 
department. However, in light of the aforementioned 
effectiveness definition, the percentage of time that an 
aircraft is MC is a measure of effectiveness. 
2. Optimum Capability Percentage 
The Optimum Capability Percentage should not be 
confused with the Optimum Performance Capability’ indicator. 
The Optimum Capability Percentage is determined by subtracting 
all NMCM and PMCM hours from EIS hours and dividing the result 
by total EIS hours. This statistic represents the maximum 
potential time the aircraft could be mission capable assuming 
that supply delays do not exist. The closer the resulting 
figure is to 100 percent, the more effective the maintenance 
efforts 
3. Mission Capability/Optimum Capability (MC/OC) Ratio 
The MC/OC ratio can be calculated by dividing the MC 
percentage by the OC percentage. This is an output measure 
that suggests the effectiveness of the maintenance effort by 
determining how close the MC rate achieved by the squadron 


meets the Optimum Capability Percentage. The closer this 


7 Optimum Performance Capability is the "maximum capability 
for successful completion on all assigned missions, through the 
availability of all equipments, within the mission capabilities of 
an aircraft or training@device." “(Ref a2 eee Di sas 
determined by subtracting all NMC, PMC, FMCM, and FMCS hours from 
the total EIS hours and dividing the result by total EIS hours. 
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Statistic comes to 100 percent, the more effective the 
maintenance department. 
4. Flight Hour Execution Ratio 
The Flight Hour Execution Ratio is flight hours flown 
divided by flight hours scheduled. Flight hours scheduled is 
the flight hour allocation granted at the beginning of the 
Quarter or month. The number of flight hours granted to each 
squadron was not available for analysis. 
5. Sortie Execution Ratio 
The Sortie Execution Ratio is the number of flights 
actually flown divided by the number of flights scheduled. By 
adding flights flown and number of aborts the total number of 
flights scheduled can be approximated. However, this 
Statistic fails to include the number of flights scheduled by 
the squadron’s operations department but were never attempted. 
The number of flights canceled by each squadron was not 
available. 
6. Utilization Rate 
Utilization Rate is defined as total flight hours 
flown divided by total hours available to fly. Total hours 
available to fly is determined by subtracting all NMC hours 
meom ETS hours. This measure can be determined from the 
Monthly Equipment Discrepancy and Utilization Report (SCIR-3). 
This is an output measure describing the quantity of time that 


the aircraft flew in relation to the number of hours it was 
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available to fly. A higher utilization rate reflects that an 
aircraft is for a greater portion of its available time. This 
might suggest a less effective maintenance effort because, in 
order to meet the squadron’s allotment of flight hours, the 
aircraft had to be utilized more. A low utilization rate 
might suggest a more effective maintenance effort because the 
squadron was able to meet its flight hour commitment without 
over-utilizing the aircraft. In addition, the utilizawien 
rate for a particular aircraft can be compared against the 
rate for the entire squadron to determine the effectiveness of 


the maintenance performed on that particular aircraft. 


E. MEASURES OF EFFICIENCY 

Efficiency was defined previously as the resources 
expected to be consumed compared to the resources actually 
consumed. Within aviation maintenance there are two basic 
resources: labor and money. Labor resources are the man- 
hours available for use in repairing aircraft. The financial 
resources are used to purchase parts and support material. 
Because cannibalization was discussed by several maintenance 
officers in the interviews as an efficiency concern, 
statistics concerning cannibalization will be discussed in 


this Section. 
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1. Labor Measures 

The research uncovered the following seven alternative 
performance measures for determining the efficiency of labor 
use. The statistics and frequency curves are intended to 
highlight.the difference in observed, historical figures, and 
not to evaluate the efficiency of any squadron’s maintenance 
errort. 

a. Labor Utilization Rate (LUR) 

The Labor Utilization Rate (LUR) reflects the 
extent to which labor was used throughout the period. LUR is 
the ratio of total man-hours expended for the period divided 
by the-.standard number of labor hours available for the 
period. The total number of man-hours can be determined from 
the Maintenance Action by Bureau/Serial Number Report (MDR-5). 
The standard number of labor hours available is calculated by 
multiplying the hours available for work, as set forth in the 
Navy Standard Workweek, [Ref. 12: Ds 5-17] by the 
total number of direct maintenance personnel and the number of 
weeks in the period. An activity that has a LUR of less than 
1.0 has a more productive labor force than an activity that 
has a LUR of greater than 1.0. Because of limitations in the 
research for this thesis, the data for this statistic was not 


obtained. 
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b. Labor Usage Rate 

The Labor Usage Rate is determined by dividing the 
total direct maintenance man-hours by the number of hours 
available for productive work for a day. The hours available 
for productive work are derived by dividing the workweek 
productive hours from the Navy Standard Workweek [Ref. 11: p. 
5-17) by five days (33.38 + 5 = 6.676 hours per day) 7a 
result is the number of man-days worked by the squadron. The 
lower the man-days, the more effective the maintenance effort. 

When a detachment is at sea, the hours available 
for productive work increases to 60 hours per week. [Ref 11: 
De os This equates to almost nine ashore man-days for 
every week at sea. Since the actual number of man-days was 
undeterminable within the limitations of this thesis, the at- 
sear man-days were assumed to be equal between squadrons iam. 
thus have little significant effect on the Labor Usage Rate 
Ste tasiei Cc. However, this assumption seriously impairs the 
diagnostic ability of this statistic within the contex@ae 
this thesis. 

c. Maintenance Man-Hour (MMH) Ratio 


Maintenance Man-Hour Ratio can be determined by 


comparing two dP rerent categories of maintenance: 
unscheduled and scheduled. Unscheduled maintenance is 
"Maintenance, other than the fix phase of scheduled 


maintenance, occurring during the interval between scheduled 
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downtime maintenance periods."[Ref. 2: p. C-36] Unscheduled 
maintenance man-hours can be found on the Special Flight 
Summary Report (NAMSO 4790.A7166-01). 

Scheduled maintenance consists’ of 'Heritedac 
prescribed inspection/servicing of equipment, done on a 
calendar, mileage, or hours of operation basis."[Ref. 2: p. C- 
30] Scheduled maintenance man-hours can be found on the 
Special Flight Summary Report (NAMSO 4790.A7166-01). 

The ratio of unscheduled maintenance man-hours 
expended to scheduled man-hours expended for the period 
describes the relationship between emergent maintenance 
actions and preventative maintenance. A ratio that is greater 
than 1.0 indicates that the unit is devoting more time to 
unscheduled maintenance than scheduled maintenance. 
Considering that preventative maintenance is pro-active, and 
that unscheduled maintenance is emergent and of higher 
priority, the degree to which scheduled maintenance exceeds 
unscheduled maintenance (a ratio less than 1.0) suggests a 
level of efficiency in the maintenance effort. 

ad. Scheduled Direct Man-Hour (SDMH) Percentage 

The Scheduled Direct Man-Hour Percentage provides 
a picture of the proportion of all direct maintenance man- 
hours for the period devoted to scheduled maintenance. The 
sateen 1s determined by dividing scheduled man-hours by 


total direct maintenance man-hours. Because scheduled 
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maintenance is essentially a preventative measure, the higher 
this percentage, the more that labor resources are devoted to 
efficient maintenance. 
e. Unscheduled Direct Man-Hour (UDMH) Percentage 

The Unscheduled Direct Man-Hour Percentage (UDMH) 
depicts the portion of total direct maintenance man-hours 
devoted to unscheduled maintenance. UDMH is determined by 
dividing all of the man-hours directed at unscheduled 
maintenance by the total number of man-hours recorded for the 
period. Unscheduled maintenance is emergent and usually of 
higher priority, and so, the lower this percentage, the less 
of the "labor pie" consumed by these activities. 

f. SCIR-Maintenance Ratio 

The SCIR-Maintenance Ratio measures the accumulated 
number of hours that maintenance discrepancies were recorded 
against the aircraft and the number of direct man-hours 
devoted to remedying those discrepancies. It is calculated by 
aieaing the SCIR hours due to maintenance (SCIR-M) by the 
total direct man-hours. This statistic is unique in that it 
captures all of the Awaiting Maintenance (AWM) hours that are 
logged against the aircraft for the month. The lower the 
result, the quicker the maintenance activity was at addressing 


the discrepancy and minimizing their AWM time. 
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g. Total Man-Hour Coverage Ratio 

Total Man-Hour Coverage Ratio is calculated by 
dividing the total direct man-hours recorded by the sum of the 
NMCM and PMCM hours (TMH/(NMCM+PMCM)). This figure shows the 
number of '’man-hours expended per hour of mission degradation. 
A high result for this metric indicates that the squadron is 
more effective at managing the time the aircraft is degraded 
for maintenance by repairing the malfunction and devoting the 
limited labor resource to other priorities. 

h. Maintenance Man-Hours per Maintenance Action 

Maintenance Man-Hours Per Maintenance Action 
(MMH/MA) is defined as the average number of man-hours 
required to complete a maintenance action. It is understood 
that some maintenance actions require many more man-hours than 
others. In the aggregate, This is still a valid measure of 
the efficiency of the maintenance effort, because a lower 
figure reflects that fewer maintenance hours are required to 
complete a maintenance action. 

MMH/MA can be determined from the Maintenance 
Action by Bureau/Serial Number Report (MDR-5). MMH/MA is 
Gerived by dividing Man-Hours Organizational by Items 
Processed Organizational. This can be done for each aircraft 


and the- squadron as a whole. 
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2. Cannibalization 

The NAMP states that "the reduction or elimination of 
cannibalization should be of prime concern to management." 
[Ref. 7: p. 4-7] Cannibalization, as defined previously, is 
the removal of a part from one aircraft for installation on 
another. While a significant factor determining the amount of 
cannibailization might be a lack of available parts in the 
supply system, it can be convincingly argued that the act of 
Ccannibalization, regardless of the reason, is outside the 
bounds of standard procedure. This does not imply that 
Cannibalization is unsafe, but, more to the point, that 
cannibalization is an inefficient maintenance practice because 
of the waste of manpower required to remove the part from one 
aircraft and install it on another. In addition, there is 
increased wear being placed on the part being removed and 
reinstalled. In the rare case that the cannibalized aircraft 
is flyable, there is the additional loss of mission functions 
to be considered. All cannibalization figures are measures of 
effectiveness because the greater the number of man-hours used 
in cannibalizing, the fewer man-hours that are directed at 
repairing aircraft. Some might argue that there is repair 
work being completed if an aircraft is returned to a flyable 
condition. Regardless of how many aircraft are flying due to 
Cannibalization, the malfunction remains and man-hours will 
Still have to be expended to repair the aircraft that was 


"robbed." 
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Peanut Zee lonemecasures are one of Che few measures 
in use by all of the squadrons surveyed. A Cannibalization 
Trend and/or Cannibalizations per 100 Flight Hours was 
included in the internal report generated each month. Along 
with Cannibalizations per 100 Flight Hours, two other possible 
eeerormance improvement measures concerning cannibalization 
will be discussed and analyzed. 

a. Cannibalization Man-Hours Percentage 

Cannibalization Man-Hours Percentage is a statistic 
that depicts the percentage of man-hours expended for 
cannibalization as a percentage of all man-hours recorded. To 
determine the percentage, the number of man-hours devoted to 
Pe oisalization is divided by the total number of man-hours 
expended during the month. This measures effectiveness by 
determining what percentage of the total direct maintenance 
man-hours are directed toward a non-value added activity. 

b. Cannibalization Items Percentage 

A cannibalization items percentage can be 
determined from the No Defect Report (MDR-12). The total of 
all items with an action (AT) code T, maintenance actions 
involving cannibalization, is divided by the total maintenance 
actions processed by the entire organization for the month, 
found on the Monthly Production Report (MDR-2).[Ref. 7: p. 4- 


7] This statistic is Similar to the previous measure, except 
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that it views the percentage of maintenance actions that did 
not contribute to repairing aircraft. 
c. Cannibalization Items per 100 Flight Hours 

This statistic is determined by dividing the number 
of items cannibalized by a divisor that is the result of the 
total flight hours divided by 100. This suggests that the 
number of cannibalizations are in some way dependent upon the 
number of flight ™heurs i lewn: This measure is currently 
employed by many of the squadrons in their monthly maintenance 


summary . 


Er. MEASURES OF QUALITY 
Quality was defined in Chapter III as "the degree to which 
the system conforms to requirements, specifications, or 
expectations." [Ref. 9: p. 43] Performance measures that 
gauge quality address the degree to which the outputs of the 
organization met the needs of the customer or the 
specifications established. This study identified seven 
possible quality measures for evaluating maintenance efforts. 
It is suggested that further research be conducted to develop 
better reporting criteria and more adequate metrics for 
gauging this performance element. 
1. No Repair Items 
The ratio of items that do not require any repair 
action compared to the total number of items repaired by the 


intermediate maintenance activity (IMA) is an indicator of the 
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effectiveness of a unit’s maintenance effort. The higher the 
ratio, the more items are being sent to the IMA that do not 
require any action. The more effective a squadron’s 
maintenance effort, the smaller this percentage. This 
information can be found on the Component Repair/Beyond 
Capability of Maintenance Report (MDR-7). 

2. Documentation Error Rate 

The Documentation Error Rate is determined by dividing 
the total number of VIDS/MAFs submitted during the reporting 
period by the number of VIDS/MAFs containing errors. This is 
a very distant performance measure of the quality of the 
actual maintenance activity, but it is an excellent measure of 
the quality of paperwork that is being produced. This measure 
is currently used and reported in the squadron’s 3-M Monthly 
Maintenance Summary. 

3. Mean Time Between Failures (MTBF) 

Mean Time Between Failures (MTBF) represents the total 
flight hours divided by the total number of maintenance 
actions. Total flight hours can be determined from the 
Monthly Equipment Discrepancy and Unitization Report (SCIR-3) 
and the number of maintenance actions can be garnered from the 
Maintenance Action by Bureau/Serial Number Report (MDR-5). 
This statistic can be determined for each aircraft and for the 


Squadron as a whole. 


fal 


MTBF iS a Surrogate measure of quality because it 
measures a factor that represents quality of maintenance 
practices. The more flight hours that can be flown between 
maintenance actions, suggests that higher quality maintenance 
is being performed. 

4. Corrosion Control Ratio 

The Corrosion Control Ratio 1s expressed as thegeama 
corrosion control man-hours as a percentage of total direct 
man-hours expended. The total corrosion control hours can be 
determined from the Corrosion Control/Treatment Report (MDR- 
11). The total number of man-hours expended can be garnered 
from namie onan ce Action by Bureau/Serial Number Report 
(MDR-5). 

Corrosion control is the most significant form of 
preventative maintenance performed by a maintenance activity. 
It is one of the measures that is tracked by all of the 
Squadrons on a monthly basis. The greater amount of time 
allotted to preventative maintenance, the less likely that 
MalEunetions will foceur Therefore, the Corrosion Control 
Ratio is an indirect measure of the quality of the maintenance 
GEEOGE: 

5. Corrosion Control to Flight Hours Ratio 

The man-hours expended toward corrosion control 

Givided by the number of flight hours flown gives the 


Corrosion Control to Flight Hour Ratio. This measure infers 
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Eat the more corrosion control hours logged for every flight 
hour, the higher the quality of maintenance. 
6. Functional Check Flight (FCF) Ratio 

The FCF Ratio is the result when total functional 
check flight hours are divided by the number of FCFs 
completed. The assumption is that the better the quality of 
the maintenance performed, the fewer number of flight hours 
required to complete an FCF. Included in this measure is an 
indicator of the quality of the training of the maintenance 
personnel who are operating the specialized vibration 
equipment, if it is installed. 

7. Unscheduled Man-Hour Ratio 

The Unscheduled Man-Hour Ratio can be determined by 
dividing the number of unscheduled maintenance man-hours 
devoted to repair maintenance (UMH less cannibalization man- 
hours) by the total number of unscheduled maintenance man- 
hours. This statistic depicts the percentage of unscheduled 
man-hours that are employed HAT) the GOrErece1on OL 
discrepancies, and views any man-hours devoted EO 
Cannibalization as a reduction in the quality of the 


maintenance performed. 


G. MEASURES OF PRODUCTIVITY 
As noted in Chapter II, the NAMP defines productivity as 


the relationship between the outputs created by a system and 
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the inputs required to achieve those outputs. [Ref. 2: p. 2-1] 
This sieteby aime aadl four alternative measures of productivity. 
1. Total Man-Hour/Flight Hour Ratio 

Total direct maintenance man-hours divided by the 
total of flight hours flown for the period gives the Total 
Man-Hours/Flight Hour ratio. This statistic depicts the 
number of direct maintenance man-hours used for every flight 
hour & lown:. In the case of this measure, the lower the 
Seni (ine Statistic, the more productive the maintenance 
department. 

2. Scheduled Man-Hour/Flight Hour Ratio 

The Scheduled Man-Hour/Flight Hour Ratio is the result 
of dividing scheduled direct maintenance man-hours by total 
Flight heuns-= This ratio depicts the number of scheduled 
direct maintenance man-hours employed to achieve one flight 
hour. As with the Total Man-Hour/Flight Hour Ratio, a lower 
score on this measure indicates that fewer scheduled man-hours 
are being expended per flight hour. With this statistic, 
there should be a strong association between scheduled 
maintenance hours and flight hours because a large portion of 
scheduled maintenance is determined by flight hours. This 
relationship is due to certain maintenance is scheduled on a 


flight hour basis. 
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3. Unscheduled Man-Hour/Flight Hour Ratio 
The Unscheduled Man-Hours/Flight Hour Ratio describes 
the number of unscheduled direct maintenance man-hours used 
OI an hour the aircraft is flown. This statistic is 
determined by dividing the total unscheduled direct 
maintenance man-hours by the total flight hours flown during 
the period. As with the two previous measures, the lower the 
result, the better the PEOCUCEA Vey. This statistic also 
gives a picture of the number of unscheduled man-hour needed 
to support an hour of flight operations. 
4. Total Flight Hour/Total Man-Hour Ratio 
Total flight hours divided by total man-hours 
illustrates the Total Flight Hour/Total Man-Hour Ratio. This 
ratio is the inverse of the Total Man-Hour/Flight Hour Ratio. 
It calculates the number of flight hours flown for every man- 
hour consumed. The more productive a maintenance department, 


the higher this statistic. 


ye MEASURES OF BUDGETABILITY, QUALITY OF WORK LIFE, AND 
INNOVATION 
Budgetability refers to the relationship between the 
actual expenses incurred to maintain the aircraft and the 
budgeted amount for the same period. Within the context of 
the organizational-level aviation maintenance department, this 
element is primarily concerned with Aviation Fleet Maintenance 


funds (AFM). Within this performance improvement element, two 
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performance measures are suggested. The cost per flight hour 
is currently used, but it essentially applies to the budgeting 
process. Information that would have facilitated analysis of 
budgetability measures was highly flawed, therefore the 
analysis of these measures was not performed. 

1. Cost per Flight Hour (AFM/FH) 

Cost per Flight Hour is developed by dividing the 
total cost of parts and materials for the period by the flight 
hours flown for the period. This measure provides a metric 
for determining the cost in parts for each flight hour flown. 
The cost of parts can be garnered from the material control 
department in each squadron. The Cost per Flight Hour figure 
is then compared with the budgeted cost per flight hour for 
the period. 

2. Cost per Maintenance Action (AFM/MA) 

The Cost per Maintenance Action (AFM/MA) is developed 
by dividing the cost of parts and materials by the total fight 
hours flown for the period. This measure depicts the average 
cost of each maintenance action. The cost figure is the same 
as for the Cost per Flight Hour (AFM/FH) and the maintenance 
action figure can be determined from the Maintenance Action by 
Bureau/Serial Number Report (MDR-5). 

The best measure of the Quality of Work Life would be 
a survey quantifying the perceptions of the maintenance 


personnel involved in the system. Because of the subjectivity 
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of this measure and the time limitations for this study, 
developing a Quality of Work Life measure was determined to be 
beyond the scope of this thesis. 

‘Possible measures of innovation might be the number of 
Technical Publication Deficiency Reports (TPDRs), Quality 
Deficiency Reports (QDRsS) or Engineering Investigations (EIs). 
However, because of difficulty in obtaining this data and the 


time constraints, innovation measures were not developed. 


I. SUMMARY 

This chapter commenced with a description of the sources 
for the data used in the analysis of the alternative 
performance measures. The statistical methods and processes 
used to analyze the performance measures were detailed. 
Alternative performance measures were suggested for five of 
the seven performance improvement elements. The next chapter 
will provide analysis on 23 of the suggested performance 
measures within the context of four of the performance 
improvement elements. The performance measures that will be 


analyzed are summarized in Figure 17. 
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Effectiveness Measures 
Mission Capability Percentage 
Optimum Capability Percentage 
Mission Capability/Optimum Capability Percentage 
Sortie Execution Ratio 
Uti lI Zatkleoneracr1© 


Efficiency Measures 

Labor Utilization Rate 

Maintenance Man-Hour Ratio 

Scheduled Direct Man-Hour Percentage 
Unscheduled Direct Man-Hour Percentage 
SCIR-Maintenance Ratio 

Total Man-Hour Coverage Ratio 
Maintenance Man-Hour/Maintenance Action 
Cannibalization Man-Hour Percentage 
‘Cannibalization Items Percentage 
Cannibalization Items per 100 Flight Hours 


Quality Measures 
Mean Time Between Failures 
Corrosion Control) Ratac 
COr~eosion Conerol) to Flights Houinena tie 
Unscheduled Man-Hour Ratio 


Productivity Measures 
Total Direct Man-Hour/Flight Hour Ratio 
Scheduled Direct Man-Hour/Flight Hour Ratio 
Unscheduled Direct Man-Hour/Flight Hour Ratio 
Total Flight Hour/Total Man-Hour Ratio 





Figure 17 Performance Measures to be Analyzed 
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V. DATA PRESENTATION 


In Chapter IV, several performance measures were described 
and discussed within the umbrella of each performance 
improvement element. In this chapter, the performance 
measures will be analyzed with the tests described in the 
previous chapter. The results of the statistical tests 
conducted are included in Appendix C. 

The analysis of the historical data for each measure is 
intended to highlight differences existing between the 
squadrons surveyed. The analysis iS not an attempt to 
pronounce ‘Judgement on any squadron or its’ specific 
maintenance practices. The evaluation of the measure, and any 
causality determination, is to be made by the individual 
squadron within the context of its performance improvement 


program. 


A. ANALYSIS 

To illustrate the character of the observations, frequency 
distributions were generated on every performance measure for 
which data was available. For the majority of the measures, 
two graphs were compiled. The first depicts the distribution 
for all of the observations as a single group and is included 


in this chapter. The second graph highlights the FRS, LANT- 


Wes) 


Sea, and PAC-Sea groups and is located in Appendix D. For 
several of the measures, a highlighted graph is included in 
this chaeee to further amplify a specific area of the 
distribution. The highlights of the statistical tests are co- 
located with the frequency distribution of all observations. 
An asterisk (*) after a test score indicates that the result 
is statistically significant at a five percent probability 


level. 


B. EFFECTIVENESS 
1. Mission Capability (MC) Percentage 

The frequency distributions of Mission Capability are 
in Figure 18 for all LAMPS squadrons. The observed mean for 
all LAMPS squadrons was 71.30 percent, which is less that the 
Mission Capable goal of 77 percent established in the MESM 
[Ref. 10: p. 3]. The F-statistic indicated that there was 
Significance between the means of the squadrons. The t-scores 
indicated that six of ten squadron means were significantly 
different from the entire population. However, only one of 
those means was dramatically different, exceeding the group 
mean by almost 14 4=percent. Another squadron’s mean 
significant difference might be attributed to the fact that it 
waS a new Squadron and received its first aircraft in October 
of 1991. The Mission Capability statistics on the breakout 


groups indicated that there was a significant difference 
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between LANT-Sea and PAC-Sea, with LANT-Sea reporting a 


Meeater MC percentage. 


Mission Capability Percentage 
All LAMPS Squadrons 





FRS vs. SEA = ~0.98 
LANT vs. PAC = 1.87° 
LANT-S vs. PAC-S = 0.19 


60% 70% 80% 
Mission Capability Percentage 
* significant at .05 probability lever 





Figure 18 


2. Optimum Capability Percentage 
Figure 19 displays the distribution of the observed 
frequency curve for all squadrons. The ANOVA test generated 
an F-statistic of 18.07 and eight of the ten squadrons’ t- 
scores exceeded the confidence level threshold. It should be 


noted that for all of the effectiveness measures analyzed, OC 
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Optimum Capability Percentage 


All LAMPS Squadrons 


F= 18.077 


z-test 

FAS vs. SEA = -2.37° 
LANT vs. PAC = 3. 
LANT-S vs. PAC-S = 2.62° 


70% 
Optimum Capabllity Percentage 
* significant st .05 probability leve! 





Figure 19 


displayed the highest F-statistic. In addition, each of the 
activity groups displayed a significant z-score. 

The OC standard deviations are noticeably smaller than 
the MC standard deviations for each of the squadrons surveyed. 
This suggests a smaller dispersion in this measure than is 


observed in the MC figure. 
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Mission Capability/Optimum Capability Ratio 


AJI LAMPS Squadrons 


\ FRS vz. SEA 
fy LANT vs. PAC 
/ is) 
ai ne a ae ee ee | al ey a 
40% 50% 60% 70% 80% 90% 100% 110% 
Mission Capabiltty/Optimum Capability Percentage 
* significant at .05 probability level 


LANT-S va. PAC-S = -1.11 








Figure 20 


3. Mission Capability/Optimum Capability (MC/OC) Ratio 
Figure 20 depicts a frequency distribution that 
approaches a normal curve. The curve depicts a normal 
distribution that 1S centered around a mean of 80.59 percent. 
With an F-statistic of 9.19, analysis of the MC/OC 

ratio showed that the means of the squadrons’ were 
Significantly different. However, two of the squadrons with 


high t-scores were markedly different on the positive side. 


Shee, 


The activity group z-scores showed that no distinction could 
be made between the separate groups. 
4. Sortie Execution Ratio 
The distribution for all of the LAMPS squadrons can be 
EOUNnG) Aneesh guae 2 4. The mean for the distribution in 
Figure 21 is 93.35 percent. This indicates that slightly more 


than six percent of the flights attempted are being aborted 


Sortie Execution Ratio 


All LAMPS Squadrons 





FRS vs. SEA 2 -2.62° 
LANT vs. PAC = 0.32 
LANT-S vs. PAC-S = -0.04 


80% 


Percentage of Sorties Flown 
* significant at .06 probability level 





Figure 21. 
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due to maintenance problems. The highlighted Sortie Execution 
shows a normal distribution around the mean of 93.35 percent. 
The F-statistic for the Sortie Execution Ratio of 4.38 was the 
lowest observed for all of the effectiveness measures. The 
FRS vs. SEA test registered a z-score of negative 2.62. That 
score exceeded the threshold and indicated that the FRS’s 
logged more aborted flights than the remainder of the fleet. 

Examination of the t-scores and the standard deviation 
of each squadron suggests a distribution with a small spread. 
Further evidence of this comes from the majority of the data 
points falling between 90 percent and 100 percent, as seen in 
Figure 64 of Appendix D. However, it is highly probable that 
this distribution would increase its dispersion if the number 
of flights canceled was included in the denominator. 

5. Utilization Rate 

“Figure 22 displays the frequency curve for utilization 
rates for all squadrons. This curve depicts a well defined 
normal curve with a mean of 10.47 percent. Utilization rates 
in excess of 12 percent are rather remarkable, considering 
that the aircraft for those squadrons flew one in every eight 
hours the aircraft was available to fly. 

The two FRSs have significantly lower utilization 
rates than the rest of the fleet, with a z-score exceeding the 
threshold by almost eight points (-10.3038 to 1.645). The z- 


scores of the LANT vs. PAC and LANT-Sea and PAC-Sea barely 
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Utilization Rate 
All LAMPS Squadrons 


FAS vs. SEA = -10.30° 
- LANT vs. PAC = -1.87° 


BE LANT-S vs. PAC-S = -1.09° 
Tove 


8% 10% 12% 14% 16% 18% 20% 22% 24% 
Utilization Percentage 
* significant at .05 probability leve! 





Figure 22 


clear the 95 percent confidence level threshold. The F- 
Statistic of 8.55 indicates that the squadron means are 
Gifferent. The t-statistic shows a fairly tight grouping for 
the squadron means. However, five of the ten squadron means 


exceeded the required threshold. 
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C. EFFICIENCY 
1. Labor Usage Rate 
Figure 23 displays the Labor Usage Rate frequency 
curve for all of the LAMPS squadrons. The mean of this normal 
curve is 954.3 man-days. The curve also appears to approach 


a normal curve. 


Labor Usage Rate 


All LAMPS Squadrons 





FRS vs. SEA = -1.93° 
LANT vs. PAC = 10.35°* 
LANT-S vs. PAC-S = 10.17" 


1.4 


(Thousands) 
Man Days 


* algnificart at .05 probabiilty level 





Figure 23 


The ANOVA, with an F-statistic of 61.78, determined 
that the squadrons were significantly differentiated. The 


test between the FRS and SEA groups showed the FRS 


87 


Significantly lower than the deploying squadrons. However, 
there was a significant difference between the LANT and LANT- 
Sea when tested against PAC and PAC-Sea respectively. The 
LANT mean was 1158.9 man-days compared to the PAC squadron’s 
mean of 733.2 man-days. In addition, Che LANT-Sea yield am 
mean of 1206.8 man-days and PAC-Sea had a mean of 712.0 man- 
days. In both cases, the z-score exceeded ten. This 
indicated that there exists a significant difference between 
the Atlantic and Pacific Fleet units in the number of man-days 
used during a month. The t-scores of the squadrons showed a 
highly dispersed population, with specific scores ranging from 
10-6 Go megarive 10.26. 
2. Maintenance Man-Hour (MMH) Ratio 

Figure 24 graphically displays the ratio for all LAMPS 
squadrons from January 1991 to December 1992. The curve is 
centered around a mean of 0.62 unscheduled man-houreo@eeag 
a Seana deers eee 

There was a large variation in the observed means of 
the squadrons. This was evidenced by nine of the squadron 
means exceeded the 95 percent confidence level, and an F- 
Statistic of 50.07. All of the activity tests yielded a z- 
score in excess of the five percent probability level. The 
level to which the LANT activities scored lower than the PAC 
activities was very significant. All of the Atlantic Fleet 


units yielded a negative t-score which indicated that these 
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Maintenance Man-Hour Ratio 
All LAMPS Squadrons 








FRS va. SEA = 4.10° 
LANT va. PAC = -16.67° 
LANT-S vs. PAC-S = -15.80° 





0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 
Unscheduled Direct Maintenance Man-Hours/Scheduled Direct Maintenance Man-Hour 
* significant at .05 probability leve! 





Figure 24 


squadrons commit fewer hours to unscheduled maintenance that 
the Pacific Fleet squadrons. 
3. Scheduled Direct Man-Hour (SDMH) Percentage 

The frequency distribution is pictured in Figure 25 
for all LAMPS squadrons surveyed, and depicts a well defined 
normal curve with a mean of 64.09 percent. At 74.10, the F- 
Statistic for the Scheduled Direct Man-Hour Ratio is the 
highest observed for all of the proposed efficiency measures. 


The t-scores for the individual squadrons are highly 
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Scheduled Direct Man-Hour Percentage 


Ajl LAMPS Squadrons 


HSL-51 


ANOVA 
F = 74.10° 


z-test 
FRS vs. SEA = 5.22 
LANTvs.PAC = = 17.56° 
Ds LANT-S vs. PAC-S = 17.56" 
- 40% 50% 60% 70% 80% 90% 
Sceduled Direct Maintenance Man-Hours/Direct Maintenance Man-Hour 
* significant at .05 probability level 





Figure 25 


dispersed, ranging from 11.90 to negative 9.12. These 
Statistics show very different distributions indicating that 
there are significant differences between the percentage of 
total man-hours devoted to scheduled maintenance among the 
squadrons. The FRS mean is significantly lower than that of 
the deploying squadrons. However, the LANT vs. PAC z-score of 
17.56 shows that more direct maintenance man-hours were 


devoted to scheduled maintenance by the East Coast squadrons. 


=e, 


Unscheduled Direct Man-Hour Percentage 
Ali LAMPS Squadrons 








FRS vs. SEA = §22° 
LANT vs. PAC @ -17,55° 
LANT-S v3 PAC-S =-17.55* 


10% 20% 30% 40% 50% 60% 
Unscheduled Direct Maintenance Man-Hours/Direct Maintenance Man-Hour 
* significant at .05 probability leve! 





Figure 26 


4. Unscheduled Direct Man-Hour (UDMH) Percentage 

Figure 26 shows a mirror-image distribution for all 
LAMPS Becarons. The mean for the curve is 35.91 percent. 
The PAC-Sea mean of 44.70 percent, compared to a LANT-Sea mean 
of 24.87 percent, shows that the deploying West Coast 
squadrons devoted a larger portion of man-hours to unscheduled 
maintenance than their LANT-Sea counterparts. 

The analysis of this measure showed that it was a 


mirror-image of the Scheduled Direct Man-Hour Ratio. The 


a 


Statistically significant events are the same whether the 
Unscheduled or Scheduled Direct Man-Hour Ratio is used. 
Therefore, it iS not recommended that these two measures be 
used concurrently. However, the causes of these differences 


should be investigated. 


SCIR-Maintenance Ratio 


All LAMPS Squadrons 


HSL-45 
HSL-46 
HSL~48 
HSL-49 
HSL-51 





ANOVA 
F= 12.42° 


z-test 

FAS ve. SEA = 1.71° 
LANT vs. PAC = -§.30° 
LANT-S vs PAC-S = -3.70" 
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SCIR-Malntenance Hours/Direct Maintenance Man-Hour 
* significant at .05 probability teve! 





Figure 27 


5. SCIR-Maintenance Ratio 
The frequency distribution in Figure 27 shows a skewed 
curve with a mean of 0.94 SCIR-maintenance hours per direct 


maintenance man-hour. 


oi2 


This is the only measure where all of the t-scores 
were determined to be outside the 95 percent confidence level. 
The phearved F-statistic of 12.42 also indicated that the 
means of the individual squadrons were significantly different 
from each other. In addition, only three of the observed 
means for the squadrons were greater than 1.0. The z-scores 
also showed that the participants in the activity tests were 
Gifferent, with the LANT activities lower than the PAC 
activities. 

6. ‘Total Man-Hour Coverage Ratio 

Figure 28 depicts the distribution for all LAMPS 
squadrons. The curve pictures approaches a normal curve with 
a mean of 7.25 percent. 

The Total Man-Hour Coverage Ratio had the lowest F- 
Statistic (3.66) of all of the efficiency measures. The Fleet 
Replacement Squadrons had a significantly lower mean than the 
deployable squadrons, 4.44 and 7.98 respectively. The LANT 
vs. PAC and LANT-Sea vs. PAC-Sea comparisons yielded no 
Significant difference. Both z-scores failed to exceed the 
five percent probability threshold. When the standard 
deviations were viewed for each of the data groups, vast 


dispersion was evident. 
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Total Man-Hour Coverage Ratio 


All LAMPS Squadrons 


ay 


FRS vs. SEA = §.62° 
LANT vs. PAC = 1.35 
LANT-S vs. PAC-S = 0.94 


1 2 3 4 § 6 7 8 9 11 12 13 
Tota! Direct Maintenance Man-Hour/Degraded Maintenance Man-Hour 
* aignificant et .05 probability level 





Figure 28 


7. Maintenance Man-Hours per Maintenance Action 

The frequency curve for all LAMPS squadrons is 
pictured in Figure 29. The distribution is slightly skewed 
with eae of 4.35 maintenance man-hours per maintenance 
UGE ION 

The MMH/MA measure generated an F-statistic of 39.76 
which far exceeded the five percent probability threshold of 
1.88. This indicated that the means of the squadrons were 


Significantly different. The tests of the specific activities 
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Maintenance Man-Hours/ Maintenance Action 


Ail LAMPS Squadrons 





FRS vs. SEA = -10.36° 
LANT vs. PAC = 3.39° 
LANT-S vs. PAC-S = 396° 


Total Direct Maintenance Man-Hours/Maintenance Action 
* significant et .05 probability level 





Figure 29 


yielded z-scores that exceeded the 95 percent confidence 
level. The z-score for the FRS vs. SEA test was negative 
10.36, which indicated that the FRS has a significantly lower 
MMH/MA than the deploying squadrons. The observed t-scores 
for the two FRS squadrons also indicated the lower MMH/MA. 
8. Cannibalization Man-Hour Percentage 
Figure 30 depicts the frequency distribution of the 


data points for all LAMPS squadrons. The distribution is 


25 


skewed to the right with a mean of 1.88 percent of direct 


Maintenance houmse used ror eeanntoal! 1 Zatwone 


Cannibalization Man-Hour Percentage 
All LAMPS Squadrons 


FRS vs. SEA = 10.12° 
LANT vs. PAC » -3.92° 
LANT-S vs. PAC-S = -4.81° 





1.0% 2.0% 3.0% 4.0% 5.0% 6.0% 
Cannibalization Man-Hours/Direct Maintenance Man-Hour 
* significant at .06 probability level 





Figure 30 


The mean for all of the observations was 1.8776 
percent, with a standard deviation of 1.322 percent. This 
indicates that the distribution was moderately dispersed. 
With an observed F-statistic of 20.69, the squadron means are 
Significantly different. The FRS vs. SEA activity test 
yielded a z-score of 10.1181, which indicated that a larger 


percentage of cannibalization man-hours is recorded by these 


US 


activities than in the fleet squadrons. Both LANT vs. PAC 
tests yielded significant z-scores, with LANT activities lower 


than PAC activities. 


Cannibalization Items Percentage 
All LAMPS Squadrons 


z-test 

FRS vs. SEA - 691° 

LANT vs. PAC = -2.05° 

LANT-S vs. PAC-S = -2.04° 
1.0% 2.0% 3.0% 


Cannibalization Items/Maintenancs Actions 
* significant at .0S probability level 





Figure 31 


9. Cannibalization Items Percentage 
The picture in Figure 31 shows a distribution that 
approaches the normal curve that is centered around a mean of 
169 percent of maintenance actions devoted ES 
cannibalization. The mean of the maintenance actions devoted 


to cannibalization for each of the activates is 2.44 percent 
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for the FRS, 1.38 percent for LANT-Sea units and 1.62 percent 
for the PAC-Sea deployable squadrons. 

The Cannibalization Items Percentage displayed similar 
statistical results to the $Cannibalization Man-Hour 
Percentage, with the exception of the tighter, less dispersed 
Standard deviations. The F-statistic of 10.82 signaled that 
the squadron means were different, and the t-scores had six of 
ten squadrons fall outside the 95 percent confidence 
DPalamerere 

10. Cannibalization Items per 100 Flight Hours 

The frequency curves for items cannibalized for every 
100 flight hours for all LAMPS squadrons is shown in 
Figure 32. The distribution is skewed to the right with a 
mean of 5.92 items. The FRS’s mean is 11.21 items 
cannibalized for every 100 flight hours flown. This is 
Significantly greater than the LANT-Sea average of 4.58 items 
and the PAC-Sea mean of 4.47 items. 

“The activity tests showed the Fleet Replacement 
Squadron’s with a greater mean of Cannibalization Items per 
100 Flight Hours than the deploying squadrons, which concurs 
with the findings of the two previous measures. However, the 
LANT activities were not significantly different from the PAC 
activities with regards to this statistic. In addition, the 
mean and t-score of one squadron were markedly lower than the 


rest of the squadrons. 
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Cannibalization Items per 100 Flight Hours 


All LAMPS Squadrons 
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* significant at .05 probability level! 





Figure 32 


D. QUALITY 
1. Mean Time Between Failures (MTBF) 

The distribution of historical observations for all 
LAMPS squadrons surveyed is pictured in Figure 33. The 
resulting distribution approximates the normal curve with a 
mean of 0.38 flight hours between maintenance actions. 

The MTBF measure yielded an F-statistic of 21.59 which 
indicated that the unit means were significantly different. 


The resulting t-scores showed the two Fleet Replacement 
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Mean Time Between Failures 
All LAMPS Squadrons 


FAS vs. SEA © -13.37° 
LANT vs. PAC = -2.90° 
LANT-S vs. PAC-S = -3.11° 
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Total Flight Hours/Maintenance Action 
* significant at .06 probability level 





Figure 33 


Squadrons with means that were greater than nine points below 
the mean for all activities. One fleet squadron has a 
resulting t-score that was seven points greater than the group 
mean. The activity z-test comparing the FRS with the fleet 
squadrons, resulted in a score of negative 13.37 showing the 
FRSs significantly below the SEA group. In addition, the LANT 
activities were markedly lower that the PAC activities with z- 


scores of negative 2.96 and negative 3.11 respectively. 
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2. Corrosion Control Ratio 
The bimodal distribution representing all squadrons is 
pictured in Figure 34. The distribution has a mean of 26.49 
percent corrosion control man-hours per direct maintenance 


hours and a standard deviation of 16.02 percent. 
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Figure 34 


The F-statistic of 132.99 for the Corrosion Control 
Ratio was the highest observation of all the Quality measures, 
and the highest observation for all of the measures analyzed. 


In addition, the range of squadron means extended from a low 
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of 9.446 percent to a high of 55.53 percent. The LANT vs. PAC 
and LANT-Sea and PAC-Sea activity tests showed the LANT groups 
devoting significantly higher percentages of man-hours to 
corrosion control than their PAC counterparts. The resulting 
z-scores of 15.51 for the LANT vs. PAC test and 14.92 for the 
LANT-Sea vs. PAC-Sea test highlighted this difference. 
3. Corrosion Control to Flight Hours Ratio 

The distribution of all squadrons surveyed in 
Figure 35 is highly skewed with a mean of 5.06 corrosion 
control hours per flight hour. The highlight curve pictured 
in Figure 36 appears to be a uniform distribution. The 
Standard deviation of 9.57 hours supports this conclusion. 

The highest observed Corrosion Control to Flight Hour 
Rate mean was 15.09 hours, with two squadrons reporting CC/FH 
Ratio means of less than 1.0. In both LANT vs. PAC activity 
tests, LANT activities scored significantly higher with a z- 
score of 5.26 for all Atlantic and Pacific Fleet activates and 
a score of 4.85 for the deploying units. 

4. Unscheduled Man-Hours Ratio 

The resulting frequency distribution for’ the 
Unscheduled Man-Hour Ratio is shown in Figure 37. The 
distribution is skewed slightly to the left with a mean of 
94.81 percent of all unscheduled man-hours devoted to 
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Figure 35 


With an F-statistic of 11.55, the means of the 
Squadrons are not Similar. The activity test yielded a z- 
score of negative 7.48 that indicated that the FRS mean was 
Significantly lower than that of the deploying squadrons. The 
resulting t-scores for the two FRSs were negative 5.48 and 
negative 3.29 which illustrates the magnitude of the 


difference between the FRS and the remainder of the squadrons. 
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Figure 36 
E. PRODUCTIVITY 
1. Total Man-Hour/Flight Hour Ratio 

Figure 38 displays the results for all LAMPS squadrons 
and Figure 39 is a highlight of the same group. The highlight 
frequency distribution in Figure 39 depicts a fairly normal 
distribution below 30 maintenance man-hours per flight hour. 
The mean for the frequency curve for all LAMPS activities is 


15.90 man-hours with a standard deviation of 19.37 man-hours. 
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Figure 37 


‘The Total Man-Hour/Flight Hour Ratio resulted in the 
lowest F-statistic, 4.66, for all of the Productivity 
measures. The observed mean of one squadron exceeded its next 
competitor by 12 man-hours. The range of the means of the 
squadrons: ranged from 7.592 to 34.3 man-hours per flight hour. 
Both of the activity tests showed the Atlantic Fleet squadrons 
exceeding those of the Pacific Fleet with scores of 3.10 and 
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Total Man-Hours/Flight Hour Ratio 


All LAMPS Squadrons 


FRS vs. SEA = 0.06 
LANT vs. PAC = 3.10° 
LANT-S vs. PAC-S = 2.93° 
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Figure 38 


2. Scheduled Man-Hour/Flight Hour Ratio 
Figure 40 is a highly skewed frequency distribution 
with a mean of 10.80 man-hours of scheduled maintenance per 
flight hour. Figure 41 depicts the frequency distribution for 
a highlight of all LAMPS’~ squadrons. The resulting 
distribution appears to more closely resemble a normal 
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Total Man-Hours/Flight Hour Ratio 


All LAMPS Squadrons (Highlight) 
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* significant at .05 probability level 





Figure 39 


3. Unscheduled Man-Hour/Flight Hour Ratio 
So teserequency distribution for ally LAMPS squadrons is 
Shown in Figure 42 and depicts a highly skewed curve that 
closely resembles the curves for the preceding two measures. 
Figure 43 depicts the frequency curve for the associated 
highlight of all squadrons surveyed. This distribution, with 
a mean of 5.10 man-hours shows a curve that is dramatically 


less skewed than the graph in Figure 42. 
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Figure 40 


From the ANOVA test, an F-statistic of 7.21 was 
determined, which indicated that the Squadron means are 
Significantly different. The observed means had a range of 
BeZ02 Eo Woe oce In addition three squadrons had standard 
deviations greater than 2.5. The z-score for the FRS vs. SEA 
activities yielded a significant score of 4.54692, which 


exceeded the five percent probability threshold. 
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Scheduled Man-Hour/Flight Hour Ratio 


All LAMPS Squadrons (Highlight) 





6 8 10 12 14 16 18 
Scheduled Direct Maintenance Man-Hours/Flight Hour 
* significant at .05 probability level 





Figure 41 


4. Total Flight Hour/Total Man-Hour Ratio 

The curve pictured in Figure 44 shows a normal 
distribution centered around a mean of 0.09 flight hours per 
direct maintenance man-hour. The observed means are: 0.06 
Meegnte hours for the FRS group; 0.08 flight hours for the 
LANT-Sea units; and 0.11 flight hours for the PAC-Sea 
deploying squadrons. 

Analysis of the Flight Hour/Total Man-Hour Ratio 


yielded an F-statistic of 23.70, the highest for all of the 
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Unscheduled Man-Hours/Flight Hour Ratio 


All LAMPS Squadrons 


FRS vs. SEA = 655° 
LANT va. PAC = -1.32 


LANT-S vs. PAC-S = -0.98 
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Figure 42 


productivity measures. Eight of the squadron t-scores fell 
outside the 95 percent confidence threshold. In addition, all 
of the activity tests garnered significant results. Witha 
z-score of negative 7.86, the FRS either logged significantly 
less flight hours per maintenance man-hour than the deploying 
squadrons, or significantly more maintenance hours than flight 
hours. The z-scores of negative 4.42 and negative 4.48 show 
the LANT and LANT-Sea groups performing comparatively to the 


FRS activities. 
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Unscheduled Man-Hours/Flight Hour Ratio 


All LAMPS Squadrons (Highlight) 
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Figure 43 


F. SUMMARY 

This chapter commenced with a description of the sources 
for the data used in the analysis of the alternative 
performance measures. The statistical methods and processes 
used to analyze the performance measures were detailed. 
Within the umbrella of each performance improvement element, 
several measures were described, discussed and analyzed. In 
addition, frequency distributions were compiled and graphed 


for all LAMPS squadrons, and three specific activity groups. 


da ileal 


Total Flight Hour/Total Man-Hour Ratio 


All LAMPS Squadrons 
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LANT-S vs. PAC-S = -4.48° 
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Figure 44 


See Figure 45 for a summary of the results of the statistical 


tests by activity. 
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FRS vs. SEA LANT vs. LANT-Sea ANOVA | 
Performance Measure PAC vs. PAC-Sea 








Yes indicates statistical significance at a 5% probability level. 
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VI. DISCUSSION OF THE MCP/PMT AND OBJECTIVES MATRIX 


TS GSMESDE of performance measures has been explained and 
many alternative performance metrics have been discussed and 
analyzed within the context of this thesis. In addition, a 
new performance measurement model has been suggested. Ah lt= 
discussion that follows explains how using the Multi-Criteria 
Productivity/Performance Measurement Model (MCP/PMT) and 
Objectives Matrix will provide the squadron maintenance 
officer with a more effective tool with which to control and 
lead the maintenance department. To highlight the use of the 
MCP/PMT model, a set of measures will be selected and used in 
comparison with the Mission Capability rate of all of the 


Squadrons surveyed. 


A. THE NEED FOR A NEW SYSTEM OF PERFORMANCE MEASUREMENT 
From the analysis in Chapter V, the differences in the 
Statistics highlight the dispersion in the metrics used to 
analyze aviation maintenance. The need to better allocate the 
limited resources available and meet the mission requirements 
is a strong impetus to re-evaluate current maintenance 
measurement practices. There are several reasons for a 
Squadron to evaluate the manner in which maintenance is 


measured and managed. 
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The primary reason for further examination of the current 
maintenance measurement system is the degree to which the 
Statistics measured and analyzed in Chapter V are diverse and 
varied, given that each squadron has relatively the same 
resources and commitments. This is evidence of the magnitude 
of the effect of the management practices on the performance 
of a maintenance department. The analysis focuses on the 
rather inescapable conclusion that there exists a tremendous 
potential for improvement in the measurement of aviation 
maintenance area. 

The second reason is the fact that for the two years of 
observed data, only one squadron mean exceeded the CNO’s goal 
of 77 percent Mission Capability. While managing to goals and 
targets is not in congruence with the total quality philosophy 
ef Dr. W. Edwards Deming and the U.S. Navy, the fact remains 
that, if current maintenance goals are truly indicative of 
operational needs, efforts need to be made to improve the 
Mission Capability percentage of the squadrons. An improved 
view of the factors affecting the performance of the 
maintenance department might serve to increase this output 
measure. 

Third, aS a measure of overall performance, the material 
condition reporting status of an aircraft or squadron is 
limited in its scope. Measures of FMC/PMC/NMC fail to address 
all of the elements that formulate a true performance measure, 


as noted in Chapter III. 


als 


Fourth, the need to re-evaluate the way maintenance 


performance is measured is based on the fact that performance 


measures, in themselves, do not improve productivity. 
[Rete 133. Spree Sy Just by measuring, either with the 
existing measures (Mission Capability, Full Mission 


Capac etc.) or the metrics proposed in Chapter III, 
improvement of maintenance performance of the squadrons will 
not be realized. To achieve value enhancing improvement, 
every aspect of the maintenance system requires examination. 
The MCP/PMT should provide an excellent starting point. 
Interviews conducted with squadron Maintenance Officers 
revealed that effectiveness is the only performance element 
that is measured by the LAMPS MK III community. Their 
perception was that if all commitments were met and all 
flights were flown, then the maintenance department must be 
optimizing all of the performance improvement elements 
(efficiency, effectiveness, quality, productivity, qualiajeyaie: 
work life, budgetability, and innovation). There were very 
few specific measures that reflected the other performance 
elements. In addition, very few Maintenance Officers had a 
clear definition of each of the seven elements, this meant 
that the definitions provided by the NAMP and Sink were used 
to develop and classify alternative performance measures. 
The final reason for scrutinizing the existing maintenance 
system with an eye towards the seven performance improvement 


elements is to remain in compliance with OPNAVINST 4790.2E. 


Ids 


The NAMP reguires all aviation maintenance activities to 


pursue all efforts to achieve performance improvement. 


B. USING THE MCP/PMT MODEL 
The Multi-Criteria Productivity/Performance Measurement 
Technique (MCP/PMT) and the Objectives Matrix® are the tools 
that will be employed to tie together the performance measures 
discussed in Chapter IV and analyzed in Chapter V. 
1. Target System/Unit of Analysis and Identification of 
Major Performance Elements 
The first step in using the MCP/PMT is to determine 
the major performance elements of the organization. In the 
case of the aviation maintenance squadron, the performance 
elements of interest are the seven performance improvement 
elements (effectiveness, efficiency, quality, productivity, 
Quality of work life, budgetability, innovations) discussed in 
Chapter III. 
Experts suggest that any discussion and development of 
performance measures for an organization should include all of 
the participants whose performance is to be measured. This 


enables the measure to have support from the participants and 


8 The MCP/PMT and the Objective Matrix are discussed in 


"Planning and Measurement in Your Organization of the Future," by 


Peers Sink and Thomas C. Tuttle. [Ref. 1: pp. 276-285] The 


majority of the discussion addressing the procedures for using the 


MCP/PMT and Objective Matrix are from that reference. 
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should provide a statistic that reflects factors that are 
controllable by, and understandable to, the organization. 
2. Develop Measures for each Performance Element 

Select specific measures that best reflect each 
performance dimension. If one performance element is deemed 
to be of significantly greater importance than the restyaiieee 
than one measure may be used to evaluated that dimension. 
When selecting a performance measure, each squadron should 
consider the factors concerning measurement criteria mentioned 


in Chapter III and summarized in Figure 46. This ensures the 


Consistent and congruent with group and organizational mission 
goals and objectives. 

Within the control of the group itself. 

Comprehensive and, as much as possible, mutually exclusive. 


Explicit and as objective as possible. 

. Challenging, not to easy, not too difficult. 

. Measurable. There should be reasonable visibility of the cause- 
and-effect relationships between group activities and each 
performance criterion variability. 





Figure 46 Factors in Developing Performance Measures 


best measure 1S chosen; one that will work toward achieving 
the performance improvement goals of the command. 

In illustrating the MCP/PMT model, alternative 
measures were chosen for each of the performance improvement 
elements. The was no intention to suggest that the measures 
selected are the best metrics for meaSuring performance for 
each of the performance elements. The measures were chosen to 


highlight the high degree of dispersion between the squadrons. 
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Performance Dimension Performance Measure 


Effectiveness Utilization Rate 
Efficiency Maintenance Man-Hour Ratio 


Productivity Total Direct Man-Hour/Flight Hour 
Ratio 


Quality Mean Time Between Failures 


Budgetability None 











Quality of Work Life None 


Innovation None 


Figure 47 Performance Measures Selected For Use in the MCP/PMT 
Model . 





(See Figure 47) As noted in Chapter III, alternative 
Perprormance measures were not considered for the Quality of 
Work Life, and Innovation elements. Because data was 
unavailable, Budgetability was not measured. 
3. Develop a Performance Scale for each Performance 

Measure and Element 

eee a rating system is established for different 
levels of performance. An acceptable level of performance for 
the measure receives the median score of 50. An outstanding 
level of performance iS awarded a score of 100. An 
unsatisfactory performance level is given a score of 0. 
Within these three points, other levels of performance can be 
given appropriate scores. The result should be a scale of 
performance levels with corresponding scores from 0 to 100. 

In developing the model for this thesis, the mean 


value for each performance measure from the entire sample of 


in 


all LAMPS squadrons was given the middle score of 50. The 
other levels were determined from analyzing the maximum and 
minimum observed values and the standard deviation of the 
sample. 

4. -Develop Ranking, Rating, and Weighting for the 

Elements and Measures 

Each performance improvement element should be ranked 
in order of importance on a scale of one to seven, with the 
highest priority element being ranked first, the second 
highest priority element being ranked second, etc. Once 
ranked, each element should be given a weight in relation to 
its importance. The highest ranked element should be given 
the weight of 100. The element ranked second should be given 
a weight that is of equal or lesser value than that given to 
the first ranked element. This procedure should be followed 
for the, remaining elements, ensuring that the ranks and the 
weights correspond. 

The final operation is developing a percentage factor 
for each element. The percentage factor is determined by 
Gay 1a aang each factor’s weight by the sum of all the weights. 
The percentage factor depicts the relative proportionality of 
each performance improvement element and associated measure. 
One implication inherent in the weight is that it gives the 
Squadron maintenance officer a benchmark as to how much time 


to devote to each element. 
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Criteria Weight Beni Rank 
Saw ae 
[eeticiency | 3 | 79 | es | ores | 5 
fouarity | an | os | too | otc | 
[productivity | 5 | 02 | 87 | ores | a 


pudgetability patti 8 0.106 -—_1— 


Quality of Work 
Life 


Sra ee oe 0.131 _ 





Figure 48 Results of Rankings of Performance Improvement 
Criteria 


During the interviews with the squadron and wing 
Maintenance Officers, the nine respondents were asked to rank 
and weight the seven performance improvement elements. These 
inputs were tallied and the result is shown in Figure 48. 
These weights were used to compute the subjective weightings 
for the Objectives Matrix. The budgetability element was 
ranked lowest by all of the West Coast MOs. This was probably 
due to the fact that West Coast squadrons do not receive an 
AFM budget. 

“Because data for measures addressing three of the 
performance improvement elements, data for those measures were 
not analyzed. Any attempt to develop a score for the three 
elements that were omitted would have a mitigating effect on 


the model. The remaining four performance improvement 
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Performance Criteria Rank Adjusted Subjective 
Weight Weighting 
Effectiveness 27 ee, 0.258 
[Eeticiency | ot] 0.230 


Quality 0.274 


Z 100 
productivity 0.238 
1.000 


Figure 49 Adjusted Rankings and Weightings 








elements were re-weighted based on the sum of the adjusted 
weight for those four elements. The results are included in 
Figure 49. 
5. Use the Matrix 

In using the MCP/PMT model and Objectives matrix, data 
on each performance measure is usually gathered and reported 
on a monthly basis. Each observed measure is compared to the 
matrix and the score is determined. The score is multiplied 
by the percentage factor. The sum of the raw scores for each 
performance improvement element yields the final performance 
score. This score can be tracked over time to determine if 
the performance of the activity has improved. In addition, 
the results of any performance improvement initiatives can be 
measured by the change in the performance score. Figure 50 
displays the completed matrix used in this thesis. 

The squadron should revisit this model as necessary. 
Consideration should be given to changing the levels of 


performance scores as the squadron improves. In addition, 
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Figure 50 The 


Objectives Matrix 
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None 





Innovation 


None 
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performance measures should be scrapped if they cease to 


provide useful information. 


C. PROS AND CONS OF THE MCP/PMT MODEL AND OBJECTIVES MATRIX 

neu aeqeee benefit of the MCP/PMT model and Objectives 
Matrix is the increased visibility of the entire maintenance 
picture. The model provides the squadron maintenance officer 
with a method to divide and analyze the activity of the 
squadron’s maintenance department within the umbrella of the 
seven performance improvement elements required by the NAMP. 
It assists the MO in selecting the most appropriate activities 
and their associated performance measures to monitor his 
department. In addition, it provides an avenue for feedback 
on the progress of the performance improvement initiatives 
implemented by the squadron. 

While the model is relatively simple to use, there are 
some obvious criticisms that warrant mention. The first is 
that the model treats each element as mutually exclusive. 
(Ref. 1: p. 285] In every system, there exists some amount of 
interplay and dependence between all of the performance 
elements in the system. However, this doesn’t detract from 
the overall value of the model, because focusing attention on 
each of the different performance elements creates a whole 
picture of the system that is useful in evaluating performance 


improvement actions. 
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HSL-40 


Performance Score vs. MC Percentage 





1991 - 1992 
Performance Score = Mission Capability 





Figure 51 


Second, the model is only as good as the information 
used. If the performance measures do not represent the 
performance improvement element or the data collection 
procedures are flawed, then the resulting performance score 
will be also flawed. However, this holds true with all 
measurement systems. As discovered from the interviews with 
the squadron maintenance officers, the current measures are 
capable of being gamed to improve the appearance of 
performance of the squadron. 

Third, the model is a very simplistic snapshot of a 


very complex system. While this is true, it is also a major 
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Performance Score vs. MC Percentage 
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Figure 52 


selling point. As no metrics currently exist for measuring 
aviation maintenance activities in the light of the seven 
performance improvement elements, this model will provide a 
Starting point for developing a better understanding of the 


maintenance system. 


D. OBSERVED OUTPUT OF THE MCP/PMT MODEL 

The performance measure observations, listed in Figure 47, 
were applied to the performance matrix in Figure 50. The 
resulting performance score for each LAMPS MK III squadron 


surveyed was calculated for each month and graphed. The 
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Figure 53 


corresponding Mission Capability Percentage for the same 
period was included in the graph for contrast. The resulting 
graphs are Figure 51 through Figure 60. 

At a minimum, two things can be noted from studying the 
graphs. The first is the wide disparity in the output of the 
MCP/PMT model for each squadron. An inference that might be 
drawn is that the maintenance system, in the context of 
Deming’s philosophy, is out of control. This strongly 
reenforces the need to scrutinize the entire organizational 
level maintenance system and make efforts to improve its 


performance and to better utilize the resources available. 
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Figure 54 


The second point that can be established from examining 
Figure 51 through Figure 60 is that there seems to be little 
correlation between the resulting MC rate and the performance 
score. While it might be argued that the performance measures 
used in the MCP/PMT model and the Objectives Matrix do not 
accurately reflect maintenance performance, it should be noted 
that the output of the model is a picture of how the resources 
available to the command were utilized to achieve the 
corresponding MC rate. This suggests that the usage of 
resources has little impact on the readiness of the squadron. 


More to the point, it becomes apparent that tremendous 
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Figure 55 


Opportunities exist for improving the management of these 
resources and improving the performance of the maintenance 


department of the squadron. 


E. SUMMARY 

This chapter opened by enumerating several reasons for 
reevaluating the performance measures currently used in 
aviation maintenance. A discussion of the reasons for 
choosing the MCP/PMT model and Objectives Matrix followed. 
The steps required to utilize the MCP/PMT model were 


explained, and the model was demonstrated for each of the 
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Figure 56 


Squadrons surveyed for the period between January 1991 to 


December 1992. 


130 


HSL-46 


Performance Score vs. MC Percentage 





Performance Score Mission Capability 





Figure 57 
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Performance Score vs. MC Percentage 











Performance Score Mission Capability 
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Figure 60 
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VII. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


In addition to planning and controlling the actions of a 
unit, it is necessary to measure its operating performance in 
order to effectively manage the organization or activity. 
Well developed performance measures provide the manager with 
effective tools for cultivating the highest level of 
performance from his department, and achieving the squadron’s 
objectives, without sacrificing his people or the quality of 
the maintenance performed. 

In Chapter III, the fundamental tenets of measuring 
performance within an organization were discussed. 
Performance improvement was further divided into seven 
elements: effectiveness; efficiency; productivity; quality; 
budgetability; quality of work life; and innovation. in 
addition, the fundamental concepts behind the MCP/PMT model 
and Objective Matrix were introduced as a vehicle for 
incorporating the seven improvement elements into a single 
measure. However, three improvement elementS were not 
analyzed due to lack of data. 

In Chapters IV and V, a multitude of performance measures 
were enumerated and described. As was feasible, each 
performance measure waS analyzed uSing a variety of 


statistical tests. For the budgetability element, linear 


133 


regression was attempted to evaluate the relationship between 
flight hours and AFM funds, and attempt to determine if an 
alternative to the current budgeting equation could be 
determined. However, it was determined that the data received 
was Significantly flawed and thus a valid budgetability 
measure could not be generated. This was due to two reasons, 
the first concerning the accounting methods used to account 
for AFM expenditures. The division of the AFM funds 
Supporting Atlantic/Second Fleet and Sixth Fleet operations, 
combined with the flight  “heur ~lamaracvems? inserted 
insurmountable bias into the research figures. Compound the 
East Coast peculiarities with the unstructured AFM trough 
Ebates | at NAS North Island, and the possibility of developing 
reasonably accurate base data becomes almost impossible within 
the time constraints of this projects. 

The steps required to used Multi-Criteria Perform- 
ance/Productivity Measurement Technique and Objectives Matrix 
were delineated in Chapter VI. The Objectives Matrix was 
built using data received from interviews and evaluated. The 
resulting performance scores were plotted for each squadron 
and compared with the current maintenance measure, Mission 


Capability Percentage. 


A. CONCLUSIONS 
From the research conducted in this thesis, several 


conclusion can be advanced. First, the lack of depth of the 
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Mission Capability Rate for describing the performance of the 
maintenance department. The data analyzed by this thesis on 
performance measures indicated that there is little 
consistency of the unit’s outputs figures. As a picture of 
the resources applied to the maintenance problems of a 
squadron, there appears to be little proportionality between 
the resources used to achieve a given performance level. 

The second conclusion that can be formulated is that the 
way Maintenance is managed and performance iS measured 
requires further examination. This appraisal should be 
conducted by each squadron within the auspices of a broad re- 
evaluation of the entire maintenance system and its 
Objectives. This need is evident from the general lack of 
understanding by the maintenance officers interviewed on the 
different performance improvement elements. 

Third, the suggested MCP/PMT model and Objectives Matrix 
will provide a more comprehensive look at the manner by which 
the limited resources are apportioned in conducting 
maintenance. The current measure attempts to capture only the 
effectiveness element of the maintenance effort. Use of the 
MCP/PMT model and Objectives Matrix will focus attention on 
the neglected performance improvement elements which have been 
noted by ‘the NAMP aS an important factors in a squadron’s 
performance improvement effort. Through the model, the 


Ssquadron’s maintenance leadership will become aware of the 
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impact O£ any performance improvement initiatives 


instituted. 


B. RECOMMENDATIONS 

Within the context of the research conducted anepars 
thesis several recommendations are suggested. Spal af=\ =, - 
squadrons. should examine maintenance activities in light of 
effectiveness, efficiency, PEOdueeiVilcy. qua laa 
budgetability, innovation and quality of work life. This 
includes tracking maintenance department performance using the 
MCP/PMT and the Objectives Matrix to develop a performance 
score that can be traced over time to reflect gains made by 
the squadron in improving their performance. Each squadron 
maintenance department should track the information required 
for their performance measures to minimized any delay due to 
inherent lags in the MDR system. 

However, the results of the model and matrix are not 
recommended for use as a method for evaluating the performance 
of the maintenance officer, or the maintenance department. If 
evaluations of this kind are absolutely necessary, the 
Maintenance officer and the department should be evaluated on 
use of the model and any subsequent performance improvement 
programs initiated. 

A third recommendation is that the Pacific Fleet LAMPS 
squadrons be given an AFM budget and thus be given positive 


control over all their resources. Control over their funds. 
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imperative if the maintenance officers are to effectively 
evaluate existing maintenance options with regards to cost and 
budget constraints. As the situation stands, the LAMPS 
squadron maintenance purchases are affected by factors beyond 
the control of the sSquadron’s maintenance officer. In 
addition, every squadron should begin to compare their actual 
cost per flight hour with the budgeted rate. This would help 
establish the validity of the AFM budgeting procedure. 

The last recommendation to be formulated by this study is 
to include a thorough explanation of performance measures in 
the NAMP, OPNAVINST 4790.2 (series). Consideration should be 
given to including the MCP/PMT model and Objectives Matrix, 
and a listing of some of the performance measures included in 
this work in Chapter 4, Data Analysis, of Volume V of the 


NAMP. 


C. AREAS FOR FUTURE STUDY 

During the course of research of this thesis several items 
emerged. that should be studied. The first is the NAMSO 
maintenance database. The current level of accuracy needs to 
be established, the barriers to achieving 100 percent accuracy 
should be enumerated, and procedures to improve the validity 
of the information that support the NAMSO database should be 
developed. 

A topic that proved to be a barrier to the achievement of 


the objectives of this thesis and thus should be addressed is 
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the manner by which AFM is apportioned on each coast. With 
the creation of HSLWPAC in the summer of 1993, the 
organizational hierarchies serving the East and West Coast 
LAMPS squadrons are now the same. If NAS North Island decides 
to continue its practice of not apportioning AFM funds to 
squadrons, the effect this practice has on the readiness of 
the LAMPS squadrons is worthy of examination. 

The final area for study is the applicability of the 
Multi-Criteria Productivity/Performance Measurement Technique 
and the Objectives Matrix to other naval activities. The 
possibility exists for this model to provide an effective tool 
for managing the performance of Squadrons in other aviation 


communities as well as surface combatants and shore commands. 
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APPENDIX A 


The primary functions of the squadron maintenance officer 


are as follows: 


a. Administer the operation of the maintenance 
department in accordance with the NAMP. 


b. Employ sound management practices in the handling of 
personnel, facilities, and material. 


c. Define and assign responsibilities, functions, and 
operations in accordance with existing directives. 


ad. Initiate requests for, and make recommendations 
relative to, changes concerning personnel, facilities, and 
equipment required to accomplish assigned tasks. 


e. Ensure the accomplishment of training for permanently 
and temporarily assigned personnel. 


f. Analyze the mission of the department and ensure that 
timely planning iS conducted and a statement of 
requirements to meet future needs is initiated. 


g. Ensure full and effective employment of assigned 
personnel. 


h. Ensure that the productions output of the department 
is of proper quantity and quality on accordance with 
applicable specifications and directives. 


1. Maintain liaison with other department heads and 
representatives of higher authority and other maintenance 
organizations, fOr example, attendance at monthly 
intermediated maintenance activity (IMA) supply maintenance 
meetings. 


Jj. Publish and ensure internal compliance with 


maintenance, safety, and security procedures to ensure 
optimum performance is achieved. 


BE 


k. Scheduling and holding periodic planning and informal 
meetings with all officers and senior petty 
officers/noncommissioned officers. 


1. Ensure the monitoring of all maintenance programs, 
for example, fuel, hydraulic and oil contamination, foreign 
object damage, corrosion control, and nondestructive 
inspection. 


m. Provide data analysis summaries to the CO and other 
superiors in the chain of command when they are requested. 


n. Ensure the IMRL? is frequently reviewed and 
necessary changes submitted, accurate equipage records are 
maintained, and required reports are submitted. 


o. Ensure the NMcSs/pmMcs?9 status listing is validated, 
certified, and returned to supply on a daily basis. 


p. Ensure the efficient operations of the Maintenance 
Data System (MDS). 


q. Ensure that the applicable publications and 
directives are disseminated throughout the maintenance 
department . 


r. Recommend qualified candidates for engine turnup 
licensing (fixed and rotary wing). 


Ss. Participate on the plane captain selection and 
examining board. 


t. Ensure that local instructions and procedures are 
compatible with MDS. 


u. Ensure that each work center supervisor thoroughly 
understands the importance of the MDS, its operation, and 
the need for continual accuracy. 


Individual Material Readiness List (IMRL). A consolidated 
list showing items and quantities of certain SE required for 
material readiness of the aircraft ground activity to which the 
list applies. OPNAVINST 4790.2E, Vol. II, Appendix C, p. 3. 


10nNMCS/PMCS is Not Mission Capable - Supply (NMCS) or Partial 
Mission Capable - Supply (PMCS). It refers to a mission capability 
designation for aircraft that are either unable to fly or unable to 
perform a specific mission because of there is an outstanding 
requisition for parts against the aircraft. 
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v. Ensure that supervisory and quality assurance (QA) 
personnel are thoroughly familiar with compass calibration 
requirements in accordance with MIL-STD-765A (NOTAL). 


w. Use maintenance management teams, as required, in 
support of efficient maintenance material practices by the 
maintenance department. 


x. Use the on site Naval Air Systems Command 
(NAVAIR) /Naval Aviation Engineering Services Unit field 


service representatives, as required, to effect liaison and 
Support for the NAMP."[Ref. 2: p. 3-5] 


abe 1. 


APPENDIX B 


Aviation Fleet Maintenance funds can be used to finance 


the cost of the following: 


a. "Paints, wiping rags, towel service, cleaning agent, 
and cutting compounds used in preventative maintenance and 
COFrOSsiONn COntre!] 16 f-aimeciraume. 


b. Consumable repair parts, miscellaneous material, and 
Navy stock account parts used in direct maintenance of 
aircraft including repair and replacement of AVDLRs and 
Gelaeedmechn a: 


c. Pre-existing, consumable maintenance material meeting 
requirements of NAVSUP Publication 485 (NOTAL) used jan 
maintenance of aircraft, aviation components, or SE. 


d. Aviation fuels used at I-level in test and check of 
aircraft engines during engine buildup, change, or during 
Maintenance. Oils, lubricants, and fuel additives used at 
both O- and I-level. 


e. Allowance list items (NA 00-35QH series (NOTAL)) used 
strictly for maintenance, such as, aprons (impermeable), 
coveralls (explosive handlers), face shields (industrial), 
gloves (gas welders), goggles (industrial and 
nonprescription safety glasses. 


f. Fuels used in related SE (shipboard only). 


g. Replacement of components used in test bench repair. 


llszk is Support Equipment. All Individual Material Readiness 
List (IMRL) and nonIMRL equipment required to make an aeronautical 
system, command and control system, support system, subsystem, or 
end item of equipment (SE for SE) operational in its intended 
CNnvi GOnment. = (REE. 22 tee on 
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h. Maintenance or equipment replacement of aircraft 
loose equipment listed in the AIR??. 


i. Consumable hand tools used in the readiness and 
maintenance of aircraft, maintenance and repair of 
components, and related equipment. 


j. Safety and flight deck shoes used in maintenance 
shops. 


k. Repair and maintenance of flight clothing and pilots 
and crew equipment. 


1. Authorized decals used on aircraft. 


m. Replacement of consumable tools and IMRL allowance 
items. 


n. Items consumed in interim packaging/preservation of 
aviation fleet maintenance repairables. 


Oo. Items, such as VIDS/MAFs, MAF bags, equipment 
condition tags, and COG 11 forms, and publications, used in 
Support of direct maintenance of aviation components or 
aircraft. 


p. Authorized special purpose clothing for unusually 
dirty work while performing maintenance of aircraft. 


q. Civilian labor only when used in direct support of 
aviation fleet maintenance. 


r. Costs incurred for IMRL repair. 
S. Replacement of general purpose electronic test 
equipment (GPETE) allowance items which are missing or 


unserviceable (COG 2). 


t. Oils, lubricants, and fuel additives consumed during 
flight operations. 


u. Navy stock account repairable material (nonAVDLR) 
used in direct maintenance of aircraft component repair, or 
related SE. 

v. The requisitioning of material incidental to TD 
installation, for example, fluids, epoxies, and shelf life 


12aTR is Aircraft Inventory Reporting system. The AIR is a 
list of serialized equipment installed on the aircraft. 


ia 3 


items, not to exceed one thousand dollars per TD per 
squadron. [R6i. 2:5. pps 6s on 
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ALL SQDNS 


ERS 
SEA 
LANT 
PAC 


LANT-Sea 
PAC-Sea 


HSL-40 
HSL-41 
HSL-42 
Heu-43 
HSL-44 
Holi-45 
HSL-46 
HSL-48 
HSL-49 
Mol-51 


APPENDIX C 


MISSION CAPABILITY PERCENTAGE 


ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
fo ls- 5) 


DF 
=) 
Papa 
230 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


(Effectiveness) 
N MEAN STDEV vo at ee 
231 712306 11.665 
48 70.05 9.14 
183 71.627 2 2243 
Le) 72.652 9.299 
111 69.84 13.67 
96 y ales 9.82 
87 71.45 14.52 
24 76.09 5.82 3.39 45 1.645 
24 64.03 7.79 -4.12 34 1.645 
24 72005 9.77 0.40 30 1.645 
24 65.17 12.82 -2.25 27 7 Os 
24 68.42 pL aRe 9, -1.10 Pal 12703 
24 85.01 5.31 10.31 50 1.645 
24 ecw all 10.19 0.77 29 1.699 
24 73.58 5.50 1.68 48 1.645 
24 74.33 8.40 1.62 33 1.645 
15 55.17 13.46 -4.53 15 1.753 
SS MS F p Fo.05 
11766.5 ie Om 4 14.79 0.000 ie 
19534.9 88.4 
31301.4 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
MEAN STDEV --------- +--------- +----- ee ee +------- 
76.090 5.822 (--*---) 
64.030 7.795 (--*---) 
72.150 9.767 —-*--) 
65.167 12.822 (--*--) 
68.421 12.322 (--*--) 
85.005 5.315 (--*--) 
73 011 10.190 (--*--) 
73.582 5.496 (--*--) 
74.334 8.398 (oe 42s) 
55.167 13.458 (---*---) 
Se eee I 
9.402 60 72 84 
“t 20.05 
-0.983453 1.645 
1.81369 1.645 
PAC-Sea: 0.186782 1.645 
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OPTIMUM CAPABILITY PERCENTAGE 


(Effectiveness) 
N MEAN STDEV t df tes 

ALL SQDNS 231 88.085 6.592 
FRS 48 86.517 4.561 
SEA 183 88.496 6.980 
LANT 120 89.456 4.300 
PAC 111 86.603 8.159 
LANT-Sea 96 89.799 4.317 
PAC-Sea 87 87.059 8.862 
HSL-40 24 88.079 4.030 -0.01 37 1.645 
HSL-41 24 84.950 4.600 -3.03 ae 1.645 
HSL-42 24 88.07 5.15 -0.01 31 1.645 
HSL-43 24 83.36 25 -3.06 ING | 1.703 
HSL-44 24 89.821 4.141 1.83 36 1.645 
HSL-45 24 94.439 2.558 9.36 62 1.645 
HSL-46 24 91.286 4.339 3.25 35 1.645 
HSL-48 24 90.008 3.009 2.56 S0 1.645 
HSL-49 24 89.972 3.582 Die22 41 1.645 
HSL-51 15 76.52 10.68 -4.14 14 1 sen 
ANALYSIS OF VARIANCE 
SOURCE DF Ss MS F p Fos 
FACTOR 9 AD 37 a7 470.9 18.07 0.000 De Ant 
ERROR 221 5757.5 26.1 
TOTAG » eo 9995.2 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN STDEV ----- +--------- ee ee +- 
HSL-40 24 88.079 4.030 (--*--) 
HSL-41 24 84.950 4.600 (--*--) 
HSL-42 24 88.073 5.152 (--*--) 
HSL-43 24 83.362 7.248 (--*--) 
HSL-44 24 89.821 4.141 (--*--) 
HSL-45 24 94 .439 2.558 (--*--) 
HSL-46 24 91.286 4.339 (--*--) 
HSL-48 24 90.008 3.009 (2 Sess) 
HSL-49 24 89.972 3.582 (--*-) 
HSL-51 15 76.523 10.682 (--*---) 

Se tem rem mm eben re oR - oe 
POOLED STDEV = 5.104 7720 84.0 91.0 98.0 

a 2,05 

FRS vs. SEA: -2.36657 1.645 
LANT vs. PAC: 3.28603 1.645 
LANT-Sea vs. PAC-Sea: 2.61672 1.645 
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ALL SQDNS 


FRS 
SEA 
LANT 
PAC 


LANT-Sea 
PAC-Sea 


HSL-40 
HSL-41 
HSL-42 
ol - 43 
hob- 44 
HSL-45 
HSL-46 
HSL-48 
mois- 49 
eg = 5 1 


MISSION CAPABILITY/OPTIMUM CAPABILITY RATIO 


ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
iol 5 1 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


130 
206 


44.7 
1.8 


eoo7 


2 ok 


PAC -Sea: 


(Effectiveness) 
MEAN STDEV 
80.594 9.482 
80.81 8.28 
80.537 9.792 
81.080 8.540 
802070 10.419 
79.5965 8.817 
81.39 10.75 
86.338 4.485 
75.2293 T.5i 
81.66 757 
17-255 10.44 
75.89 abe Re cial 
90.00 4.98 
19 277 8.63 
81.73 5.14 
B2°.52 7.82 
71.94 gas ee: = 20 

MS F 
625.9 9.19 
68.1 


df 


PRP PPP PP PPB 


INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 


0.197844 
0.802422 
=i Oo 7 
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- ee = w= = & = = = 


.645 
.645 
.645 
.103 
o/ U6 
.645 
“029 
-645 
.645 
,1o3 


SORTIE EXECUTION RATIO 


(Effectiveness) 
N MEAN STDEV t df Cee 

ALL SQDNS 231 93.349 4.349 
FRS 48 92.162 2520 
SEA 183 93.660 4.557 
LANT 120 93.437 4.904 
PAC als 93.254 3.675 
LANT-Sea 96 93.648 5.240 
PAC-Sea 87 93.673 3.691 
HSL-40 24 92.592 22178 -1.07 32 1.645 
HSL-41 24 91.732 3.253 -2.24 32 1.645 
HSL-42 24 94.665 Dea 27 Daa 42 1.645 
HSL-43 24 93.630 2.379 0.50 41 1.645 
HSL-44 24 93.60 6.00 g.20 25 1.708 
HSL-45 24 95.496 Dela 4.12 46 1.645 
HSL-46 24 94.08 5.39 0.65 26 1.706 
HSL-48 pA 94.380 2.845 1.59 35 1.645 
HSL-49 24 94.637 2.005 2.58 49 1.645 
HSL-51 15 89.29 5.69 =2°. 71 15 1.753 
ANALYSIS OF VARIANCE 
SOURCE DF SS MS F p Foos 
FACTOR 9 546.8 60.8 4.38 0.000 24 
ERROR 2 1! 3064.5 13.9 
TOTAI 230 3611.3 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN STDEV --------- $-----+---- pore ----- force e-- 
HSL-40 24 92.592 32177 (----*----) 
HSL-41 24 91.732 3.253 (----*----) 
HSL-42 24 94.665 2.327 (----*----) 
HSL-43 24 93.630 22379 (----*----) 
HSL-44 24 93.603 6.001 (----*----) 
HSL-45 24 95.496 2.133 (----*----) 
HSL-46 DA 94.084 5.394 (----*----) 
HSL-48 24 94.380 2.845 (----*---=) 
HSL-49 24 94.637 2.005 (----*----) 
HSL-51 15 89.285 5.691 (------ wo ---- ) 

aia ofa $occ seer a+ 4+-- - ~~~ =] ee 
POOLED STDEV = 3.724 90.0 93.0 96.0 

2 Zo.05 
FRS vs. SEA: -2.61568 1.645 
LANT vs. PAC: 0.323455 1.645 
LANT-Sea vs. PAC-Sea: -0.0376027 1.645 
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UTILIZATION RATE 


(Effectiveness) 
N MEAN STDEV t at te cpe 

ALL SQDNS 221 Oma 4 3.766 
FRS 48 7.189 2.076 
SEA 183 11.336 3.636 
LANT 120 10.080 4.001 
PAC ius Oe 910 1 S246] 
LANT-Sea 96 PO 2o ee 3.977 
PAC-Sea 87 ii 805 3.174 
HSL-40 24 6.755 1.755 -8.54 49 1.645 
HSL-41 24 7.623 2.309 -5.36 cl, 1.645 
HSL-42 24 12.500 3.896 2243 27 1.703 
HSL-43 pel 11.798 Bee 7 1.88 29 1.699 
HSL-44 24 10.50 5.03 0.03 25 1.708 
HSL-45 — 24 alga Ieee yc FE 2.524 2202 34 1.645 
HSL-46 OA 9.314 3.439 -1.56 29 1.699 
HSL-48 oa 11.328 D710 hak 33 1.645 
HSL-49 24 12.357 3.143 De74 30 1.645 
HSL-51 15 12.21 4.14 0.67 15 1.753 
ANALYSIS OF VARIANCE 
SOURCE DF Ss MS F p Baa 
FACTOR "9 84207 93.6 8.55 0.000 240 
ERROR aA 2419.4 10.9 
TOTAL 230 2262. 1 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN STDEV --------- RES oe sess $------+--- eee ss = 
HSL-40 24 6.755 1.755 (----*----) 
HSL-41 24 7.623 2.309 a ee ) 
HSL-42 24 12.500 3.896 (----*----) 
HSL- 43 24 11.798 2) (----*¥----- ) 
HSL-44 24 10.504 5.034 (----*----) 
HSL-45 24 11.631 2.524 (-<-<--- wee n-) 
HSL-46 24 9.314 3.439 (----*----- ) 
HSL-48 24 11.328 2g 0 (----*----- ) 
HSL-49 |. 24 12.357 3.143 (----*----- ) 
HSL-51 15 Lie 2 Ti Aveo (------ ¥¥e ee -ee ) 

ee a 
POOLED STDEV = 3.309 7.5 1:00 12.5 

2 20.05 

FRS vs. SEA: -10.3038 1.645 
lent vs. PAC: -1.67003 1.645 
LANT-Sea vs... PAC-Sea: =I .60677 1.645 
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N 
ALL SQDNS 231 
FRS 48 
SEA 183 
LANT 120 
PAC al: 
LANT-Sea 96 
PAC-Sea 87 
HSL-40 24 
HSL-41 24 
HSL-42 24 
HSL-43 24 
HSL-44 24 
HSL-45 24 
HSL-46 24 
HSL-48 24 
HSL-49 24 
HSL-51 ules) 


ANALYSIS OF VARIANCE 


SOURCE DF Ss 
FACTOR 9 24054984 
ERROR 221 9560742 
TOTAL 230 33615728 
LEVEL N MEAN 
HSL-40 24 S70n 1 
HSL-41 24 809.8 
HSL-42 24 1663.2 
HSL-43 24 900.4 
HSL-44 24 3s O2.22 
HSL-45 24 805.0 
HSL-46 24 1088.5 
HSL-48 24 77 OF..3 
HSL-49 24 546.5 
HSL-51 15 526.7 
POOLED STDEV = 208.0 
FRS vs. SEA: 

LANT vs. PAC: 

LANT-Sea vs. PAC-Sea: 


LABOR UTILIZATION RATE 


(Efficiency) 
MEAN STDEV t df tig 
954.3 382.3 
890.0 beset & 
Sy 416.0 
1156-9 38257 
733.2 228.4 
1206.0 400.1 
elie. 8) 244.8 
9707 1 2236 0229 38 1.645 
809.8 133.0 -3.90 74 1.645 
1663.2 303.4 10.61 31 1.645 
900.4 227.8 -1.02 38 1.645 
1302.2 270.20 5.74 33 1.645 
805.0 125.3 -4.16 81 1.645 
1088.5 164.3 3.20 54 1.645 
77003 170.4 -4.29 Sl 1.645 
546.5 150.4 -10.28 61 1.645 
526.7 245.9 -6.26 18 1.734 
MS F Pp Fo.0s 
2672776 61.78 0.000 2,441) 
43261 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
STDEV -------¢--- +--------- +--------- +------ 
223.6 (a) 
133.0 (-* =} 
creer’ (Se 
Zod 6 (--*-) 
2700 (=<=* =) 
125.3 (a 
164.3 (ace) 
170.4 (-*-) 
150.4 -*-) 
245.9 (-*--) 
------- eee oe a. 
800 1200 1600 
2. Z 0.05 
-1.92876 1.645 
10.3535 1.645 
Oe 7: 1.645 


alesy) 8, 


MAINTENANCE MAN-HOUR RATIO 


N 
ALL SQDNS eal 
FRS 48 
SEA 183 
LANT 120 
PAC 111 
LANT-Sea 96 
PAC-Sea 87 
HSL-40 24 
HSL-41 24 
HSL-42 24 
Heom-43—« 24 
HSL-44 24 
HSL-45 24 
HSL-46 24 
HSL-48 24 
HSL-49 24 
HSL-51 15 


ANALYSIS OF VARIANCE 


SOURCE DF SS 
FACTOR 9 15.2383 
ERROR 22k 7.4734 
TOTAL 230 22.9118 
LEVEL N MEAN 
HSL-40 24 0.5763 
HSL-41 24 0.9418 
HSL-42 24 0.2453 
HSL-43 24 0.8320 
HSL-44 24 0.3497 
HSL-45 24 0.8612 
HSL-46 24 0.2638 
HSL-48 - 24 0.5343 
HSL-49 24 0-7 7320 
HSL-51 IS: 0.9174 
POOLED STDEV = 0.1839 
FRS vs. SEA: 

LANT vs. PAC: 

LANT-Sea vs. PAC-Sea: 


aE oil 


(Efficiency) 
MEAN STDEV t df Gre 
0.6183 0.3142 
OG. 7591 rez 
0.5813 0.3190 
0.3939 0.1795 
0.8608 0.2394 
0.3483 0.1587 
0.8385 0.2450 
0.5763 0.1389 =1220 SZ 1.645 
0.9418 OF 2022 fi. @ Al 35 1.645 
0.2453 OF 0911 -13.42 99 1.645 
0.8320 On 2732 3.59 29 1.699 
0.3497 O27 ps3 4 -6.98 44 1.645 
0.8612 0.2076 Sea 35 1.645 
0.2638 0.0800 -13.45 123 1.645 
0.5343 0.0973 ~-2.93 89 1.645 
0.7730 0.1729 3.78 41 1.645 
0.9174 0.3335 3.38 15 reg 53 
MS F p F 0.05 
1.6931 50.07 0.000 2.41 
0.0338 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
STDEV ----4+----r rr ere +to-f cree ee +--2-+------ +-- 
Ge 33 (er oe) 
Oe2022 (Sexe) 
0.0911 (--*--) 
On 278. (--*--) 
0.1591 Co ) 
0.2076 (--*--) 
0.0800 (--*--) 
0.0973 (--*--) 
0.1729 Coa) 
0.3335 a 
-- ef - eee eee t------ He t---- ec eee +-- 
O25 O250 C275 1-200 
2 %0.05 
4509915 P2645 
-16.6685 1.645 
=15 .8857 1.645 


SCHEDULED DIRECT MAN-HOUR RATIO 


N 
ALL SQDNS 23a 
FRS 48 
SEA 183 
LANT 120 
PAC a Na an 
LANT-Sea 96 
PAC-Sea 87 
HSL-40 24 
HSL-41 24 
HSL-42 24 
HSL-43 24 
HSL-44 24 
HSL-45 24 
HSL-46 24 
HSL-48 24 
HSL-49 24 
HSL-51 15 


ANALYSIS OF VARIANCE 


SOURCE DF SS 
FACTOR 3 2.55247 
ERROR 22 dl 0.84580 
TOTAL 230 3.39527 
LEVEL N MEAN 
HSL-40 24 0.63903 
HSL-41 24 0.52011 
HSL-42 24 0.80705 
HSL-43 24 0.55733 
HSL-44 24 0.74960 
HSL-45 24 0.54323 
HSL-46 24 0.79424 
HSL-48 24 0.65425 
HSL-49 24 0.56898 
HSL-51 25 0.53545 
POOLED STDEV = 0.06186 
FRS vs. SEA: 

LANT vs. PAC: 

LANT-Sea vs. PAC-Sea: 


(Efficiency) 
MEAN STDEV t df tie 
0.64088 0.12155 
0.5796 0.0801 
0.65696 0.12555 
0.72883 0.09021 
0.54580 0.06729 
0.75129 0.08311 
0.55288 0.06958 
0.6390 0.0553 -0.13 50 1.645 
025201 0.0 5i7 -9.12 55 1.645 
0.8071 0.0575 ey © 48 1.645 
0.5573 0.0824 -4.49 34 1.645 
0.7496 0.0781 6.09 35 1.645 
0.5432 0.0564 -6.96 49 1.645 
0.7942 0.0495 11.90 58 1.645 
0.65425 0.04082 1.16 78 1.645 
0.5690 0.0532 -5.33 53 1.645 
0.5355 0.0880 -4.38 dg 1.740 
MS F Pp F 0.05 
0.28361 74.10 0.000 24 
0.00383 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
STDEV -+--------- +--------- +--------- +----- 
0.05526 (--*-) 
0.05172 (-*--) 
0.05748 (--*-) 
0.08236 (--*-) 
0.07813 (--*-) 
0.05645 (-*--) 
0.04953 (-*--) 
0.04082 (-* 
0.05324 (--*-) 
0.08798 (---*--) 
ie iy ge eg te pee a +=) - = += 3 
0.50 0.60 0.70 0.80 
% Zo.05 
-5.22044 1.645 
17.5640 1.645 
17.5643 1.645 
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UNSCHEDULED DIRECT MAN-HOUR PERCENTAGE 


(Efficiency) 
N MEAN STDEV t df Cone 
ALL SQDNS 231 35.909 2 2154 
FRS 48 A2204 8208 
SEA 183 34.300 12.554 
LANT 126 2727 9.021 
PAC iBall 45.414 6.734 
LANT-Sea 96 24.871 82S 1 
PAC-Sea 87 44.704 6.963 
HSL-40 24 36.10 5.53 Cea 50 1.645 
HSL-41 24 47.99 5.17 9112 55 1.645 
HSL-42 24 19.29 5.75 =LlIS 70 48 1.645 
HSL-43 24 24520 8.25 Aa 34 1.645 
HSL-44 24 25.04 7.81 -6.09 35 1.645 
HSL-45 24 45.68 5.64 6.96 49 1.645 
HSL-46 24 20.58 4.95 -11.89 58 1.645 
HSL-48 24 34.575 4.082 -1.15 qh: 1.645 
HSL-49 24 43.10 5.32 5.33 53 1.645 
HSL-51 15 46.45 8.80 4.38 ile 1 
ANALYSIS OF VARIANCE 
SOURCE DF SS MS F p Foc 
FACTOR 9 25513.0 2834.8 74502 0.000 24) 
ERROR P21 8463.9 38.3 
TOTAL 230 33976.9 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
LEVEL N MEAN STDEV ----4+--------- +----- ee ee +--- ere eee +-- 
HSL-40 Da 36.097 5.526 (-*--) 
HSL-41 24 47.989 Sel72 (--*-) 
HSL-42 24 19.295 5.748 (-*--) 
HSL- 43 24 44.238 8.252 (-*--) 
HSL-44 24 25.040 7.813 -*--) 
HSL-45 24 45.677 5.645 (--*-) 
HSL-46 - 24 20.576 4.953 (--*-) 
HSL-48 24 34.575 A082 (--*-) 
HSL-49 pes 43.102 See24 (-*--) 
HSL-51 15 46.455 8.798 (--*---) 
SG FN I Pe 42) GE Seg g tee +=- 
POOLED STDEV = 6.189 20 30 40 50 
z 20.05 
FRS vs. SEA: 5.22332 1.645 
MeANrT vs. PAC: -17.5530 1.645 
LANT-Sea vs. PAC-Sea: =1725512 1.645 


Ss 


SCIR-MAINTENANCE RATIO 


(Efficiency) 
N MEAN STDEV t Get t.40 
ALL SQDNS 231 0.9434 1.1278 
FRS 48 1.144 0.822 
SEA 183 0.8909 ieyasyale:! 
LANT 120 0.5742 0.38711 
PAC aac al 1.343 1.484 
LANT-Sea 96 0.5717 0.3985 
PAC-Sea 87 ies243 1.609 
HSL-40 24 0.5842 0.2378 -4.05 165 146415 
HSL-41 24 12703 0.820 2215 32 1.645 
HSL-42 24 0.5033 0.3532 -4.25 87 1.645 
HSL-43 24 1.756 1.780 2.19 24 1.645 
HSL-44 24 0.5038 0.3751 Se abe 79 1.645 
HSL-45 24 0.3567 0.2151 -6.80 188 1.645 
HSL-46 24 0.6062 0.4369 -2.91 62 1.645 
HSL-48 24 0.6733 0.4217 -2.38 66 1.645 
HSL-49 24 0.7513 0.3072 -1.98 110 1.645 
HSL-51 15 Pa SINE 2.490 2.60 14 1.761 
ANALYSIS OF VARIANCE 
SOURCE DF ss MS F p Pou 
FACTOR 9 98.247 10.916 12a 0.000 2a 
ERROR 22 194.319 0.879 
TOTAL _ 230 292.566 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
LEVEL N MEAN STDEV -+--------- ee ee += ee 
HSL-40 Za 0.5842 02.2378 (---*---) 
HSL-41 24 1.7029 0.8203 (---*---) 
HSL-42 24 0.5033 0.3532 (---*---) 
HSL-43 24 1.7563 1.7803 (---*--) 
HSL-44 24 0.5038 Oe37 51 (---*---) 
HSL-45 24 0.3567 0.2151 (---*--) 
HSL-46 24 0.6062 0.4369 (---*---) 
HSL-48 24 0.6733 024217 (---*---) 
HSL-49 24 0.7513 On 21072 (---*--) 
HSL-51 15 2.6273 2.4903 (---*----) 
2foo eS Sess oe Spa OP SOR SS Saye eS SSS Hea SS 
POOLED STDEV 039277 0.0 .0 2.0 3.0 
< 2.05 
FRS vs. SEA: 1.70932 1.645 
LANT vs. PAC: -5.30487 1.645 
LANT-Sea vs. PAC-Sea: -3.78814 1.645 
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ALL SQDNS 


FRS 
SEA 
LANT 
PAC 


LANT-Sea 
PAC-Sea 


HSL-40 
HSL-41 
HSL-42 
HSL -4 3 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
Moi 51 


TOTAL MAN-HOUR COVERAGE 


ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSi-48 
HSL-49 
fois - 51 


DF 


9 
a2. 
230 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


ah 0) 
Jb raal 


Hb 
hUOOoOhUOWU 


1H 
Oo 


Soe, 
Fig 


MEAN 
52296 
[oo 
S107, 
.645 
fol? 
oS 
noo 7 
7030 
no 70 
~493 


ro 1G 


PAC -Sea: 


RATIO 


df 


INDIVIDUAL 95 PCT CI’S FOR MEAN 


POOLED STDEV 


PRP RPPRPRPPPP 


.645 
.645 
.645 
.645 
.645 
-645 
-645 
.645 
.645 
ar Ok 


-——-— ee ee OH OH 


yA 


cuolen ovis lia 
I 34907 
0.941623 


ESS 


(Efficiency) 
MEAN STDEV t 
7.246 7.261 
4.444 1.543 
7290n 72963 
7.880 4.376 
6.560 9.414 
S527 4.621 
T2e3 10.48 
51296 1.467 -3.46 
le Se) 1.094 -6.93 
9.04 533 153 
4.645 1.736 -4.37 
S519 32132 1.59 
LOeSs7 5 4.885 ee lal 
OSG? 5.74 22 
5 2530 2.056 -2.23 
4.970 12509 -4.00 
10.49 2, ERS a OuSo 
MS F Pp 
174.9 3.66 0.000 
47.8 
BASED ON 
STDEV -------- oi eee a op eaee 
1.467 a 
1.094 (------ he cae eae Eee ) 
Spee eal 
1.736 #£=/(------ Wetcue esas ) 
Sa 32 (eee 
4.885 
Se 742 
2.056 (Sceena ara Fee ie 
1.509 #£=«°(------ Wasa a eee ) 
24-011 


20.05 
1.645 
1.645 
1.645 


ALL SQDNS 


FRS 
SEA 
LANT 
PAC 


LANT-Sea 
PAC-Sea 


HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
HS East 


MAINTENANCE MAN-HOUR/MAINTENANCE ACTION 


ANALYSIS OF VARIANCE 


SOURCE 


FACTOR 


ERROR 
TOTAL 


LEVEL 

HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
Slow 


DF 
9 


yi 
230 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


FOS cos 
2772345 


Pm WwW Pb bb A OW Ww 


=) 


MEAN 


.4000 
sola 2 
.4921 
sag2t 
-9225 
-6308 
55129 
,eo33 
,o276 
-o2o5 


neg 2 2 


PAC -Sea: 


0.000 


df 


PRPRPPPP PRP PP 
ron 
ib 
wn 


INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 


(Efficiency) 
MEAN STDEV 
4.3518 1.0981 
3.4571 0.5077 
4.5864 Ls O92Z 
4.578 1297, 
4.1070 0.7648 
4.873 1.258 
4.2706 0.7604 
3.400 0.594 
3.5142 0.4093 
6.492 1 rss 
4.392 O72 02 
4.523 O27 22 
4.631 OF 502 
4.613 O- 707 
3.863 0.490 
3 2630 0.625 
4.525 Geass 
MS F 

19.051 39.76 

0.479 

STDEV 

O59 37 (--*--) 
0.4093 (--*--) 
1.1326 

OL 7023 
OR 7222 
075025 
0.7067 
0.4899 (--*-) 
0.6245 (ese) 
0.8149 

4.0 


z 
-10731624 

3739227 

37295305 


PSG 


CANNIBALIZATION MAN-HOUR PERCENTAGE 


N 
ALL SQDNS 231 
FRS 48 
SEA 183 
LANT il eN6) 
PAC ababat 
LANT-Sea 96 
PAC -Sea 87 
HSL-40 24 
HSL-41 24 
HSL-42 24 
HSL-43 24 
HSL-44 24 
HSL-45 24 
HSL-46 24 
HSL-48 24 
HSL-49 24 
HSL-51 cS 


ANALYSIS OF VARIANCE 


SOURCE DF SS 
FACTOR 9 183.793 
ERROR ye: 218.163 
TOTAL 230 401.956 
LEVEL N MEAN 
HSL-40 24 3.2096 
HSL-41 24 3.4887 
HSL-42 24 0.7650 
HSL-43 24 2.1196 
HSL-44 24 120058 
HSL-45 ; 24 1.1850 
HSL-46 24 Lele 7 
HSL-48 24 1.6888 
HSL-49 24 270675 
HSL-51 ils: 2.2800 
POOLED STDEV = 029936 
FRS vs. SEA: 

LANT vs. PAC: 

LANT-Sea vs. PAC-Sea: 


(Efficiency) 
MEAN STDEV t df ae 
3776 i2o220 
32349 1.148 
4916 a Re (0g 1 
oor Leas 
2.224 12290 
1.1441 0.8382 
gs a (a Sieber 8 
32210 OReL0 Jos a7 12645 
3.489 1.412 5435 ae L703 
0. 765 0.597 = 70 53 1.645 
2 Zo 02.930 16 33 1.645 
1.006 O 2aa9 -4.63 a6 1.645 
dR es 0.946 S27 33 645 
dt aligned 0.504 = 5165 64 1.645 
ines? 1.079 -0.80 30 J 645 
2.068 iS 0.74 29 doo 
Ze O10 1.446 05 15 gg Ss 
MS F Pp F.05 
20.421 2069 0.000 2.41 
O.9387 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
SLE Ve 92 oe pe 9 ee 
OF.2099 aS a =) 
1.4122 (---*---) 
045771 (---*---) 
0.9296 a= ei) 
0. 8197 ee os) 
0.9461 (atece Kao =") 
0.5044 (---*---) 
POs 7 (---*---) 
Deo (---*---) 
1.4456 (----*----) 
------- Si ee 
120 220 SO 
# Zo.05 
Ora Tot L645 
73392394 1.645 
-4.81460 1.645 


tient 


CANNIBALIZATION ITEMS PERCENTAGE 


(Efficiency) 
N MEAN STDEV t df toa. 

ALL SQDNS 231 1.6920 0.8966 
FRS 48 2.439 0.852 
SEA 183 1.4961 0.8016 
LANT 120 1.5753 0.7559 
PAC ub aleiL 1.8183 1.0157 
LANT-Sea 96 1.3800 0.6435 
PAC-Sea 87 1.624 0.933 
HSL-40 24 2.356 0.671 4.45 32 1.645 
HSL-41 24 2.522 1.009 3.87 26 1.706 
HSL-42 24 12a 0.632 -3.18 33 1.645 
HSL-43 24 2.089 0.882 22110 28 12708 
HSL-44 24 187 0.719 -3.19 30 1.645 
HSL-45 24 0.989 0.622 -5.02 33 1.645 
HSL-46 24 1.586 0.637 -0.74 33 1.645 
HSL-48 24 1.506 0.519 -1.54 39 1.645 
HSL-49 24 1.568 0.838 -0.68 28 1 Vzioe 
HSL-51 15 1.987 1.036 1.08 15 1.753 
ANALYSIS OF VARIANCE 
SOURCE . ODF ss MS F p Fane 
FACTOR 9 56.531 6.281 10.82 0.000 Bal 
ERROR PAPAL 128.349 0.581 
TOTAL 230 184.880 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN STDEV --------- t-cccc eee o-o------- t--r--e-- 
HSL-40 24 2.3563 0.6712 (----* = 220) 
HSL-41 24 PAPA he 1.0092 (--- = eee 
HSL-42 24 1.2408 0.6315 (----*----) 
HSL-43 24 2.0892 0.8822 (----%*----) 
HSL-44 24 1.1875 0.7189 (----*----) 
HSL-45 24 0.9887 0.6223 (----*----- ) 
HSL-46 24 1.5858 0.6370 (----*----- ) 
HSL-48 24 1.5058 0.5189 (----*----) 
HSL-49 24 1.5683 0.8376 (----*----) 
HSL-51 15 1.9867 1.0362 (----- weeecee ) 

Se 4 Sli lal a iil SS 
POOLED STDEV = 0.7621 120 1.80 2.40 

2 2.05 

FRS vs. SEA: 6.90691 1.645 
LANT vs. PAC: -2.04999 1.645 
LANT-Sea:vs. PAC-Sea: -2.04082 1.645 


158 


ALL SQDNS 


FRS 
SEA 


CANNIBALIZATION ITEMS PER 100 FLIGHT HOURS 


ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL- 44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
Peis—5 1 


DF 
S 
we 
230) 


POOLED STDEV 


FRS vs. 


LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


Ss 
2 eel 
2500-2 
ol ia ae ae 


PAC -Sea: 


(Efficiency) 
MEAN STDEV t df ee 
5917 4.742 
pie eet 4.285 
4.528 3.788 
6.029 4.864 
S eye 4.626 
4.584 3.972 
4.466 3.595 
11.808 3.699 70 31 1.645 
10.613 4.806 4.56 2a iby [ee ! 
3201 24328 -4.78 46 1.645 
5.428 1.885 -0.99 60 1.645 
5.84 5.56 -0.07 26 106 
127.00 1.204 -10.62 124 1.645 
5.695 4.469 -0.23 28 OL 
3.605 1.726 -4.91 68 1.645 
2015 il. 2.441 -4.09 43 1.645 
8.88 4.93 2.26 15 1.753 
MS F Pp F .05 
263.6 20.80 0.000 2740 
12 7 
INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 
STDEV ---------- tooo ccc eee torr etecree +------ 
3.699 (oi ae 
4.806 Makai hee) 
22228 oa oe) 
1.885 (Se) 
5556 (a>) 
1.204 (--*---) 
4.469 (ea hae: 
1.726 (aia) 
2.441 (---*--) 
4.925 (---*----) 
eee S52 55- torr re cc enter rt ee renter ee ee 
4.0 8.0 12 


z Zo.05 

9.84269 1.645 
0.374485 1.645 
Oe Zier 1.645 
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ALL SQDNS 


FRS 
SEA 
LANT 
PAC 


LANT-Sea 
PAC-Sea 


HSL-40 
HSi-42 
HSil-42 
Hsi-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
Hei-49 
Hobe. 


MEAN TIME BETWEEN FAILURES 


ANALYSIS OF VARIANCE 


SOURCE 


DF 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


3 
4. 
7 


© 


OO ©: OC OO CO 2 © 


LANT-Sea vs. PAC -Sea: 


(Quality) 
MEAN STDEV 

0. 3867 OL. 1857 
0722562 0.04568 
0.4290 0.1854 
023522 0.1608 
0.4241 0.2035 
0.3889 O21587 
0.4733 0.2029 
0.20562 0.04163 
0.24563 0.04119 
0.4349 0.1484 
0.4047 O 15907 
0.3008 O° 1568 
On6s19 0.1495 
OF 3ou5 0.1624 
0.4502 0.1281 
025175 O-l3eZzs 
07 2585 Oma Se 

MS F 
0.4121 ae ie ie 
O° OTo1 

STDEV ---------- 

0.0416 (---*--) 
0.0412 (--*---) 
0.1484 
O2159. 
0.1568 
0.1495 
0.1624 
Oo1Z26. 
0.1828 
OF 2252 


Zz 


e135 707 
SPA Morale, 
ve ye aa kas al 


160 


alee eal? 


=o 252 
1.48 
Doe 

sen. Ou 
7.46 

*0 549 
2520 
S233 

ela ffl 


0.000 


df Co 05 
251 1.645 
3 1.645 

Sal 1.645 

PS) 1.622 

30 1.645 

30 1.645 

PALS, 1 3632 

a3 1.645 

28 Lio 

18 1.734 
F o.05 
2242 


INDIVIDUAL 95 PCT €i’S FOR) MEAT 
BASED ON POOLED STDEV 


CORROSION CONTROL RATIO 


(Quality) 
N MEAN STDEV t at Ci ce 

ALL SQDNS 231. 26.49 16.02 
FRS 48 18.58 8.60 
SEA 183 28.56 16.86 
EANT 1210 87242 12.93 
PAC all 14.669 9.179 
LANT-Sea 96 40.38 12.76 
PAC-Sea 87 15.52 9.68 
HSL-40 24 25.584 3.038 -0.74 189 1.645 
HSL-41 °— 24 11.57 6.29 -8.98 61 1.645 
HSL-42 24 55.53 7.29 15.93 50 1.645 
HSL-43 24 26.70 8.68 0.10 41 1.645 
HSL-44 24 38.53 9.16 5.61 39 1.645 
HSL-45 24 9.446 4.328 -12.39 iba ly. 1.645 
HSL-46 24 41.59 5.92 9.41 67 1.645 
HSL-48 24 25.87 6.02 -0.38 65 1.645 
HSL-49 24 9.502 3.666 = 3,14 146 1.645 
HSL-51 15 17.00 7.59 -4.26 23 1.714 
ANALYSIS OF VARIANCE 
SOURCE DF Ss MS F P Fi os 
FACTOR g 49806.9 5534.1 132299 0.000 De 41 
ERROR D2 1. 9196.1 41.6 
POLAT, 230 59003.1 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN SEOEV |= --— 2 = pee e-es--s $--------- $o---- +e 
HSL-40 24 25.584 3.038 a5) 
HSL-41 24 11.571 6.289 (s*) 
HSL-42 24 55.530 7.290 (-* =) 
HSL-43 24 26.698 S267 7 (-*-) 
HSL-44 med 38.525 9.163 (-*) 
HSL-45 D4 9.446 4.328 (*-) 
HSL-46 24 41.587 5.924 ay), 
HSL-48 24 25.872 6.024 (*-) 
HSL-49 24 9.502 3.666 (*-) 
HSL-51 15 P7002 7.595 (-*--) 

ee terre ee em epee re ete ne epee te cee 
POOLED STDEV = 6.451 15 30 45 60 

2 Z 0.05 

FRS vs. SEA: -5.67564 1.645 
mone vs. PAC: 15.5096 1.645 
LANT-Sea vs. PAC-Sea: 14.9221 1.645 


Aliieyic 


CORROSION CONTROL TO FLIGHT HOUR RATIO 
(Quality) 
N MEAN STDEV t df eyes 

ALL SQDNS 231 5.059 9.573 
FRS 48 3.081 1.791 
SEA 183 5.578 10.662 
LANT 120 WL) 12.50 
PAC weal a 1.908 1.841 
LANT-Sea 96 8.87 13.83 
PAC-Sea 87 1.947 1.987 
HSL-40 24 4.395 1.225 -0.98 246 1.645 
HSL-41 24 1.766 1.194 -4.88 248 1.645 
HSL-42 PM 9.79 6 712 3.38 35 1.645 
HSL-43 24 32207 1.768 0.015 195 1.645 
HSL-44 24 15.09 23.83 0.052 23 1274 
HSL-45 24 0.7308 O-3074 -6.82 236 1.645 
HSL-46 24 8.18 9.89 1.48 Og | 1.703 
HSL-48 24 2.414 1,097 -3.96 Palsvat 1.645 
HSL-49 24 0.7206 0.3104 -6.85 234 1.645 
HSL-51 15 3.725 2.682 -1.43 44 1.645 
ANALYSIS OF VARIANCE 
SOURCE —~° ODF SS MS F Pp IS Ar 
FACTOR 9 4629.2 514.4 6.91 0.000 Presa 
ERROR 274. 16446.5 744 
TOTAL 230 21075.7 

INDIVIDUAL 95 PCT CI’S FOR MEAN 

BASED ON POOLED STDEV 
LEVEL N MEAN STDEV ----- +--------- +------- ee +---- ccc ee +- 
HSL-40 24 4.395 1.235 (----*----- ) 
HSL-41 24 1.766 1.194 (ee ose aS ace ) 
HSL-42 24 9.791 6.120 (eee Fee eee ) 
HSL-43 24 Se277 1.768 (22-2 *----- ) 
HSL-44 24 15.089 23.832 (----- pl ) 
HSL-45 24 C2731 Oe ciy gi RS See ko---- ) 
HSL-46 24 8.183 9.886 (----- *----) 
HSL-48 24 2 Ar4 12097 (----- kona -- ) 
HSL-49 24 G72 1 0.310 (----- *----- ) 
HSL-51 15 3.725 2.682 (------ wae ene ) 

SS 5 ieee lad elt teats ett 2 
POOLED STDEV = 82627 620 6.0 162 eaG 18.0 

“2 ~0.05 

FRS vs. SEA: -3.01105 1.645 
LANT vs. PAC: 5.25720 1.645 
LANT-Sea vs. PAC-Sea: 4.85075 1.645 
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ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
HSL-40 
HSL-41 
HSL-42 
HSL-43 
HSL-44 
HSL-45 
HSL-46 
HSL-48 
HSL-49 
mens 5 1 


DF 


POOLED STDEV 


FRS vs. 
LANT vs. 


SEA: 
PAC: 


LANT-Sea vs. 


76 
161 
237 


ss 
Cnet 
1.45 
S.25 


“079 


.705 


PAC - Sea: 


UNSCHEDULED MAN-HOUR RATIO 


(Quality) 
MEAN STDEV 
94.808 3.216 
eats 3.350 
95-680 2.644 
94.549 3.402 
95.088 22900 
957425 2.660 
oS os 2.636 
90.763 3.462 
92 1605 3.007 
96.074 23ou5 
95.079 22200 
96.228 22770 
97.403 2.106 
94.556 2.008 
95.124 2.760 
95.200 2.583 
95.0739 3.156 
MS F 
84.53 LieSs5 
Tae 
STDEV --+------- 
3.462 (---*---) 
22607 
22815 
22a © 
207 0 
2.106 
2.008 
2.760 
2.583 
3.156 
ey sees fede 
90.0 
Z 
-7.47602 
-1.28067 
-0.658741 


Pp 
G 7000 


df 


703 
2701 
“699 
.645 
5692 
.645 
.645 
(699 
.645 
3 


PRPPRPPPRPHPP 


INDIVIDUAL 95 PCT CI’S FOR MEAN 
BASED ON POOLED STDEV 


IGS 


20.05 
1.645 
1.645 
1.645 


ALL SQDNS 
FRS 


TOTAL DIRECT MAN-HOUR/FLIGHT HOUR RATIO 


ANALYSIS ‘OF VARIANCE 


SOURCE DF 
FACTOR 9 
ERROR PAean 
TOTAL 2320 
LEVEL N 
HSL-40 24 
HSL-41 24 
HSL-42 24 
HSL-43 24 
HSL-44 24 
HSi-45 24 
HSL-46 24 
HSL-48 24 
HSL-49 24 
Holo L5 


POOLED STDEV 


FRS vs. SEA: 
LANT vs. PAC: 
LANT-Sea vs. 


PAC - Sea: 


(Productivity) 
MEAN STDEV 
257910 Tipe ENT 
157,982 4.409 
15.88 PL ASS 
gE Es S30) 25.66 
125002 6.566 
20209 28 0 
Lab 2 53 7.067 
Li 25 Saas 
14.717 32103 
L723 9.48 
11.896 3.460 
34.3 49.3 
fet P48, jens 
19.46 22639 
9.273 2.955 
fens)” 2.317 
21.74 LO.45 
MS F 
1530 4.66 
328 
SE ee + 
Sie 
3.10 (s==='> a 
9.48 
3.46 (oa oe x 
49.30 
195 (eo 
22539 
Poel, ae 
Pa FMM igh! So er ) 
10.45 ( 
22 ---- ee + 
LZ 
Z 
0.0601154 
3.09566 
PA gis Wei er 


t df 
G781 114 
O28 3 PORP 
OMS 7 46 
“215 202 
ite ey 23 
=o. 5 252 
O75 26 
-4.69 ELPAT 
-6.11 25.0 
diy 20 
Pp F o.05 
0.000 2.41 


INDIVIDUAL 95 PCT CI’S FOR MEAN 


BASED ON POOLED STDEV 
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Son cons ond eee er ee ke Ke Ke epee me ee 
Henne ) 
=) 
a ) 
secee ) 
(----- too --- ) 
(----- Honeee ) 
3s eee ee ) 
ie peoess-. ee 
24 36 
20.05 
1.645 
1.645 
1.645 


ALL SQDNS 


FRS 
SEA 
LANT 
PAC 


LANT-Sea 
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